00000001:02000400:3.0F:1788521570.880220:0:2960:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing set_hostid 00000001:02000400:3.0:1788521588.999688:0:3182:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1788521590.410241:0:3225:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 979 MB/s 00000001:01000000:2.0F:1788521590.660820:0:3225:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 739 MB/s 00000001:01000000:2.0:1788521590.910649:0:3225:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5583 MB/s 00000020:02000000:0.0:1788521591.428577:0:3273:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_gdacfdd2 00000400:02000000:1.0F:1788521592.020006:0:3288:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.206.148@tcp [8/256/0/180] 00008000:02000000:2.0:1788521595.300997:0:3438:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788521634.230443:0:5237:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788521642.992642:0:5814:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788521642.992649:0:5814:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788521642.992750:0:5814:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000036923fbd 00000080:02000400:0.0:1788521642.992759:0:5814:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1788521642.998672:0:5814:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1788521642.998684:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788521642.998794:0:5814:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000000c0283b5) 00000020:00000080:1.0:1788521642.998812:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788521643.048049:0:5814:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788521643.049618:0:5814:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788521643.107368:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788521643.107392:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788521643.107403:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788521643.107450:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788521643.107465:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788521643.107749:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788521643.107756:0:5814:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788521643.107766:0:5814:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b7b50db5927b914 00000020:01000004:1.0:1788521643.107773:0:5814:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788521643.107777:0:5814:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788521643.107781:0:5814:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000036923fbd from MGS 00000020:01000004:1.0:1788521643.107785:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788521643.107803:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000ad0f2037) 00000020:00000080:1.0:1788521643.107813:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788521643.107851:0:5814:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000036923fbd from MGS, refs=2 00080000:01000000:1.0:1788521643.107853:0:5814:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788521643.107856:0:5814:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b7b50db5927b922 00000100:00100000:1.0:1788521643.108020:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788521643.108168:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788521643.108174:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788521643.109170:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788521643.109179:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788521643.111037:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788521643.111247:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788521643.111252:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788521643.111814:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788521643.111822:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788521643.112202:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788521643.112209:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788521643.115321:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521643.115327:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521643.115330:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521643.117036:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521643.117041:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521643.117044:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521643.117764:0:5814:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788521643.121970:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788521643.367183:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3111 MB/s 00000001:01000000:3.0:1788521643.618135:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 5315 MB/s 00000001:01000000:2.0:1788521643.868679:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 739 MB/s 00000001:01000000:2.0:1788521644.119600:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1350 MB/s 00080000:10000000:0.0:1788521644.131076:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:0.0:1788521644.155956:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788521644.155974:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788521644.155977:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788521644.161550:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788521644.161599:0:5814:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788521644.161650:0:5814:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788521644.161925:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788521644.161953:0:5814:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788521644.162906:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788521644.163084:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788521644.163091:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788521644.163883:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788521644.163891:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788521644.164547:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788521644.164558:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1788521644.172326:0:5829:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1788521644.172491:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788521644.172510:0:5814:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.148@tcp' 00000020:01000004:3.0:1788521644.172512:0:5814:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788521644.172560:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.148@tcp (typ=mgc) 00000020:00000080:3.0:1788521644.172578:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.148@tcp (0000000032ed6570) 00000020:00000080:3.0:1788521644.172594:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788521644.172705:0:5814:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003ec09664@MGC192.168.206.148@tcp: add connection 192.168.206.148@tcp at head 00010000:00010000:3.0:1788521644.172852:0:5814:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.148@tcp-0 is initialized 00000040:01000000:3.0:1788521644.172858:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.148@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788521644.175516:0:5830:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788521644.175562:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.148@tcp (uuid 672d8d4a-a4f6-4b8b-95c4-7d19376ccba0) 00000020:00000080:3.0:1788521644.175581:0:5814:0:(genops.c:1385:class_connect()) connect: client 672d8d4a-a4f6-4b8b-95c4-7d19376ccba0, cookie 0x1b7b50db5927b930 00000100:00080000:3.0:1788521644.175593:0:5814:0:(import.c:545:import_select_connection()) MGC192.168.206.148@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788521644.175598:0:5814:0:(import.c:665:import_select_connection()) MGC192.168.206.148@tcp: import 000000003ec09664 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1788521644.175636:0:5814:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e2dc16cc x1875400816853120/t0(0) o250->MGC192.168.206.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788521644.175654:0:5814:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 672d8d4a-a4f6-4b8b-95c4-7d19376ccba0->MGS 00000020:01000004:3.0:1788521644.175670:0:5814:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788521644.175698:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788521644.175709:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000000a07b87d) 00000020:00000080:3.0:1788521644.175720:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00010000:00010000:3.0:1788521644.178469:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521644.179379:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e2dc16cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3303:1875400816853120:0@lo:250: 00000100:00100000:2.0:1788521644.179467:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521644.183319:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816853120 00000100:00100000:1.0:1788521644.183331:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816853120 00000100:00100000:1.0:1788521644.183371:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788521644.183377:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028198820 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1875400816853120:12345-0@lo:250: 00010000:00080000:1.0:1788521644.183401:0:5826:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 672d8d4a-a4f6-4b8b-95c4-7d19376ccba0@0@lo t0 exp 0000000000000000 cur 144 last 0 00000020:00000080:1.0:1788521644.183435:0:5826:0:(genops.c:1385:class_connect()) connect: client 672d8d4a-a4f6-4b8b-95c4-7d19376ccba0, cookie 0x1b7b50db5927b93e 00000100:00080000:1.0:1788521644.183551:0:5826:0:(import.c:65:import_set_state_nolock()) 000000005ea2ef88 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788521644.183619:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028198820 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+5:3303:x1875400816853120:12345-0@lo:250: Request processed in 241us (4151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521644.183626:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788521644.183827:0:3303:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.148@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788521644.183836:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.206.148@tcp: connect to target with instance 0 00000100:00080000:2.0:1788521644.183842:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.206.148@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788521644.183847:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788521644.183849:0:3303:0:(import.c:65:import_set_state_nolock()) 000000003ec09664 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788521644.183852:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788521644.183866:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788521644.183870:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e2dc16cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3303:1875400816853120:0@lo:250: 00000100:00100000:2.0:1788521644.195070:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788521644.195884:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788521644.195891:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788521644.201958:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788521644.201972:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788521644.202977:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788521644.202985:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788521644.204079:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788521644.204586:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788521644.204591:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788521644.208405:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788521644.208466:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788521644.259451:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788521644.259653:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788521644.259660:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788521644.268125:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788521644.268170:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788521644.268905:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788521644.269081:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788521644.269087:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788521644.271345:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788521644.271357:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788521644.274238:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788521644.274437:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788521644.274443:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788521644.282218:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788521644.282237:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788521644.282918:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788521644.283102:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788521644.283107:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788521644.286897:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788521644.286910:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788521644.331623:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788521644.332426:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788521644.332444:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788521644.335981:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788521644.335997:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788521644.341976:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788521644.342075:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788521644.343447:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788521644.343468:0:5814:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788521644.343473:0:5814:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.148@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788521644.343602:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.148@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788521644.343631:0:5814:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.148@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1788521644.343635:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788521644.343637:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788521644.343638:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788521644.343639:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788521644.343640:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788521644.343642:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788521644.343643:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788521644.343644:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788521644.343645:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788521644.343646:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788521644.343824:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788521644.343826:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788521644.343828:0:5814:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1788521644.343830:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788521644.343831:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788521644.343832:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788521644.343832:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788521644.343833:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788521644.343834:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788521644.343835:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788521644.343836:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788521644.343837:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788521644.343837:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788521644.343838:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788521644.343839:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788521644.343876:0:5814:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788521644.343891:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c1aa1df3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816853248:0@lo:253: 00000100:00100000:0.0:1788521644.343963:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521644.344018:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 0000000025ecc3a7 going to sleep for 11 seconds 00000100:00100000:2.0:1788521644.344095:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816853248 00000100:00100000:2.0:1788521644.344101:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816853248 00000100:00100000:0.0:1788521644.344307:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788521644.344315:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cac7f326 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+5:5814:x1875400816853248:12345-0@lo:253: 20000000:01000000:0.0:1788521644.344350:0:5827:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788521644.344353:0:5827:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1788521644.344857:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788521644.344906:0:5827:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788521644.345283:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788521644.346909:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788521644.347416:0:5827:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788521644.347421:0:5827:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788521644.347426:0:5827:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788521644.347429:0:5827:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788521644.347444:0:5827:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1788521644.348377:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788521644.349396:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1788521644.349424:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788521644.349472:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1788521644.349520:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1788521644.350324:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1788521644.350440:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1788521644.350448:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1788521644.350493:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1788521644.350501:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1788521644.350533:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1788521644.350824:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1788521644.350874:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1788521644.350927:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1788521644.350957:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788521644.350962:0:5827:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1788521644.350974:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788521644.352785:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1788521644.352807:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788521644.352855:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1788521644.352883:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1788521644.352920:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1788521644.352933:0:5827:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1788521644.353019:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1788521644.353026:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788521644.353061:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1788521644.353089:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1788521644.353115:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1788521644.353124:0:5827:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1788521644.353207:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1788521644.353214:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1788521644.353238:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1788521644.353265:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788521644.353394:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788521644.353444:0:5827:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788521644.353451:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788521644.354189:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788521644.354483:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788521644.354504:0:5827:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.148@tcp for mdt 20000000:01000000:1.0:1788521644.354506:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.148@tcp (null) (null) (null) 00000040:00080000:1.0:1788521644.354551:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788521644.354562:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788521644.354591:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788521644.354597:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.148@tcp (null) (null) 00000040:00080000:1.0:1788521644.354639:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788521644.354648:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788521644.354839:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788521644.354874:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788521644.354932:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788521644.354935:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788521644.354938:0:5827:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788521644.354948:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788521644.354950:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788521644.354974:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788521644.354983:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788521644.356016:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1788521644.356454:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1788521644.356498:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1788521644.356532:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1788521644.356612:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788521644.356615:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788521644.357084:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1788521644.357441:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1788521644.357492:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1788521644.357630:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1788521644.357644:0:5827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788521644.357646:0:5827:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1788521644.357700:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788521644.357703:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788521644.357707:0:5827:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788521644.357713:0:5827:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788521644.358315:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1788521644.358613:0:5827:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788521644.365890:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1788521644.365937:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1788521644.366019:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1788521644.366916:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788521644.366938:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000650e4629/0x1b7b50db5927b945 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.366952:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000650e4629/0x1b7b50db5927b945 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.366962:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000650e4629/0x1b7b50db5927b945 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.366968:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000650e4629/0x1b7b50db5927b945 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.366974:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000650e4629/0x1b7b50db5927b945 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.366980:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000650e4629/0x1b7b50db5927b945 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.366985:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000650e4629 already unused, calling callback (0000000086fe2ae6) 00010000:00010000:1.0:1788521644.366989:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000650e4629/0x1b7b50db5927b945 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.367009:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000650e4629/0x1b7b50db5927b945 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.367021:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000650e4629/0x1b7b50db5927b945 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.367028:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000650e4629/0x1b7b50db5927b945 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.367033:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000650e4629/0x1b7b50db5927b945 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788521644.367048:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788521644.562726:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cac7f326 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+5:5814:x1875400816853248:12345-0@lo:253: Request processed in 218406us (218757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521644.562740:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788521644.562835:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c1aa1df3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816853248:0@lo:253: 10000000:01000000:0.0:1788521644.562849:0:5814:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788521644.562851:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788521644.562853:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788521644.562854:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788521644.562856:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1788521644.562857:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788521644.562858:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788521644.562859:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788521644.562861:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788521644.562862:0:5814:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788521644.562863:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788521644.562864:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788521644.562879:0:5814:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000036923fbd from lustre-MDT0000 10000000:01000000:0.0:1788521644.562899:0:5814:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788521644.562902:0:5814:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788521644.562905:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff996f8606b380 10000000:01000000:0.0:1788521644.562908:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788521644.562914:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff996f8606b380 from 1 10000000:01000000:0.0:1788521644.562917:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788521644.562946:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 000000003c2a163e/0x1b7b50db5927b94c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521644.562970:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 000000003c2a163e/0x1b7b50db5927b94c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521644.562979:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 000000003c2a163e/0x1b7b50db5927b94c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521644.562994:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c1aa1df3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816853376:0@lo:101: 00000100:00100000:0.0:1788521644.563024:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521644.563070:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000af5ec9ef going to sleep for 11 seconds 00000100:00100000:1.0:1788521644.563124:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816853376 00000100:00100000:1.0:1788521644.563129:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816853376 00000100:00100000:1.0:1788521644.563184:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788521644.563191:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000130cc8c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+5:5814:x1875400816853376:12345-0@lo:101: 00010000:00010000:1.0:1788521644.563202:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521644.563211:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000650e4629/0x1b7b50db5927b953 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927b94c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.563229:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000650e4629/0x1b7b50db5927b953 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927b94c expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.563238:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000650e4629/0x1b7b50db5927b953 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927b94c expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.563245:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000650e4629, rc 0) 00000100:00100000:1.0:1788521644.563268:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000130cc8c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+6:5814:x1875400816853376:12345-0@lo:101: Request processed in 78us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521644.563279:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521644.563501:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c1aa1df3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816853376:0@lo:101: 00010000:00010000:0.0:1788521644.563512:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 000000003c2a163e/0x1b7b50db5927b94c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927b953 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521644.563521:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 000000003c2a163e/0x1b7b50db5927b94c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927b953 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521644.563557:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c1aa1df3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816853504:0@lo:501: 00000100:00100000:0.0:1788521644.563578:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521644.563601:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000af5ec9ef going to sleep for 11 seconds 00000100:00100000:2.0:1788521644.563646:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816853504 00000100:00100000:2.0:1788521644.563650:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816853504 00000100:00100000:2.0:1788521644.563675:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788521644.563680:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067bac3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+6:5814:x1875400816853504:12345-0@lo:501: 00000100:00100000:2.0:1788521644.563861:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067bac3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+6:5814:x1875400816853504:12345-0@lo:501: Request processed in 180us (282us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788521644.563868:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521644.563958:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c1aa1df3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816853504:0@lo:501: 10000000:01000000:0.0:1788521644.563980:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788521644.563993:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 000000003c2a163e/0x1b7b50db5927b94c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927b953 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521644.564000:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 000000003c2a163e/0x1b7b50db5927b94c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927b953 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521644.564017:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff996f85616000 10000000:01000000:0.0:1788521644.564020:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788521644.564023:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff996f85616000 10000000:01000000:0.0:1788521644.564026:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788521644.564028:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff996f85616000 from 1 10000000:01000000:0.0:1788521644.564030:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788521644.564043:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 00000000780ae12d/0x1b7b50db5927b95a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521644.564048:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 00000000780ae12d/0x1b7b50db5927b95a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521644.564056:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 00000000780ae12d/0x1b7b50db5927b95a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521644.564065:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c1aa1df3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816853632:0@lo:101: 00000100:00100000:0.0:1788521644.564086:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521644.564103:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000af5ec9ef going to sleep for 11 seconds 00000100:00100000:2.0:1788521644.564215:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816853632 00000100:00100000:2.0:1788521644.564220:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816853632 00000100:00100000:2.0:1788521644.564246:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788521644.564251:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3173b71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+6:5814:x1875400816853632:12345-0@lo:101: 00010000:00010000:2.0:1788521644.564259:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521644.564268:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f5f21d36/0x1b7b50db5927b961 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927b95a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521644.564290:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f5f21d36/0x1b7b50db5927b961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927b95a expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521644.564297:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f5f21d36/0x1b7b50db5927b961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927b95a expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521644.564303:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f5f21d36, rc 0) 00000100:00100000:0.0:1788521644.564425:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c1aa1df3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816853632:0@lo:101: 00010000:00010000:0.0:1788521644.564496:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 00000000780ae12d/0x1b7b50db5927b95a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927b961 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521644.564504:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 00000000780ae12d/0x1b7b50db5927b95a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927b961 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521644.564515:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788521644.564521:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 00000000780ae12d/0x1b7b50db5927b95a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927b961 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521644.564536:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 00000000780ae12d/0x1b7b50db5927b95a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927b961 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521644.564542:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788521644.564545:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788521644.564548:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff996f85616000 10000000:01000000:0.0:1788521644.564550:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788521644.564553:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788521644.564555:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788521644.564567:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 000000001953258f/0x1b7b50db5927b968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521644.564573:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 000000001953258f/0x1b7b50db5927b968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521644.564579:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 000000001953258f/0x1b7b50db5927b968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521644.564588:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c1aa1df3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816853760:0@lo:101: 00000100:00100000:2.0:1788521644.564660:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3173b71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+7:5814:x1875400816853632:12345-0@lo:101: Request processed in 409us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521644.564667:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521644.564767:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521644.564820:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000af5ec9ef going to sleep for 11 seconds 00000100:00100000:1.0:1788521644.564853:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816853760 00000100:00100000:1.0:1788521644.564857:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816853760 00000100:00100000:1.0:1788521644.564911:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788521644.564917:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000748e9cab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+7:5814:x1875400816853760:12345-0@lo:101: 00010000:00010000:1.0:1788521644.564924:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521644.564931:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004b1738f4/0x1b7b50db5927b96f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927b968 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.564943:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004b1738f4/0x1b7b50db5927b96f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927b968 expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.564950:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004b1738f4/0x1b7b50db5927b96f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927b968 expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.564956:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004b1738f4, rc 0) 00000100:00100000:1.0:1788521644.564986:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000748e9cab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+8:5814:x1875400816853760:12345-0@lo:101: Request processed in 70us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521644.564991:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788521644.565040:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c1aa1df3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816853760:0@lo:101: 00010000:00010000:0.0:1788521644.565049:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 000000001953258f/0x1b7b50db5927b968 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927b96f expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521644.565055:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 000000001953258f/0x1b7b50db5927b968 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927b96f expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521644.565102:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c1aa1df3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816853888:0@lo:501: 00000100:00100000:0.0:1788521644.565126:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521644.565523:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816853888 00000100:00100000:2.0:1788521644.565528:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816853888 00000100:00100000:3.0:1788521644.565565:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788521644.565573:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015e1926d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+8:5814:x1875400816853888:12345-0@lo:501: 00000100:00100000:3.0:1788521644.565763:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015e1926d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+9:5814:x1875400816853888:12345-0@lo:501: Request processed in 191us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521644.565770:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788521644.565802:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000af5ec9ef going to sleep for 11 seconds 00000100:00100000:3.0:1788521644.565815:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c1aa1df3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816853888:0@lo:501: 00000100:00100000:3.0:1788521644.565851:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001a81088f pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816854016:0@lo:503: 00000100:00100000:3.0:1788521644.565886:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521644.565910:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 0000000087f25914 going to sleep for 11 seconds 00000100:00100000:0.0:1788521644.565966:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816854016 00000100:00100000:0.0:1788521644.565970:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816854016 00000100:00100000:0.0:1788521644.566001:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788521644.566007:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9b70ce5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+9:5814:x1875400816854016:12345-0@lo:503: 00000100:00100000:0.0:1788521644.566261:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9b70ce5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+9:5814:x1875400816854016:12345-0@lo:503: Request processed in 254us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521644.566268:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788521644.566550:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001a81088f pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816854016:0@lo:503: 00000100:00100000:3.0:1788521644.566945:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001a81088f pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5857:1875400816854144:0@lo:502: 00000100:00100000:3.0:1788521644.566985:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521644.567102:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a5935b21 going to sleep for 11 seconds 00000100:00100000:1.0:1788521644.567191:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816854144 00000100:00100000:1.0:1788521644.567196:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816854144 00000100:00100000:1.0:1788521644.567223:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788521644.567230:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e204fb5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+9:5857:x1875400816854144:12345-0@lo:502: 00000100:00100000:1.0:1788521644.567424:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e204fb5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+9:5857:x1875400816854144:12345-0@lo:502: Request processed in 195us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521644.567431:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788521644.567586:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001a81088f pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5857:1875400816854144:0@lo:502: 00000020:01000000:3.0:1788521644.567610:0:5857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521644.567620:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521644.567622:0:5857:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788521644.567626:0:5857:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788521644.567629:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788521644.567641:0:5857:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000eea2923c) 00000020:00000080:3.0:1788521644.567656:0:5857:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788521644.567663:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788521644.567724:0:5857:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788521644.567730:0:5857:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b7b50db5927b97d 00000020:00000080:3.0:1788521644.567947:0:5857:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788521644.567952:0:5857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521644.567956:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521644.567957:0:5857:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788521644.567960:0:5857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521644.567964:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521644.567965:0:5857:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788521644.567967:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788521644.567974:0:5857:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000308ae926) 00000020:00000080:3.0:1788521644.567984:0:5857:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788521644.567988:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788521644.567995:0:5857:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788521644.567998:0:5857:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788521644.568004:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788521644.568048:0:5857:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000036923fbd from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788521644.568069:0:5857:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000c395e0e0) 00000020:00000080:3.0:1788521644.568079:0:5857:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788521644.568171:0:5857:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788521644.568177:0:5857:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b7b50db5927b992 00000020:00000080:3.0:1788521644.568267:0:5857:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788521644.568273:0:5857:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788521644.568277:0:5857:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1b7b50db5927b999 00080000:01000000:3.0:1788521644.568282:0:5857:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788521644.568284:0:5857:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b7b50db5927b9a0 00080000:10000000:3.0:1788521644.568806:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788521644.569062:0:5857:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788521644.573569:0:5857:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788521644.654653:0:5857:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788521644.654938:0:5857:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788521644.659072:0:5857:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788521644.659725:0:5857:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788521644.707789:0:5857:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000007dfe1d87) 00000020:00000080:3.0:1788521644.707810:0:5857:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788521644.707868:0:5857:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788521644.707884:0:5857:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b7b50db5927b9ae 00000020:00000080:1.0:1788521644.709825:0:5857:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788521644.714933:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788521644.773845:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788521644.807099:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788521644.846789:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788521644.885858:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788521644.919825:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1788521644.957049:0:5857:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1b7b50db5927b9b5 00000020:00000080:3.0:1788521644.957552:0:5857:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788521644.957563:0:5857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521644.957569:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521644.957571:0:5857:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788521644.957574:0:5857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521644.957583:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521644.957584:0:5857:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788521644.957587:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788521644.957589:0:5857:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788521644.957592:0:5857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521644.957594:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521644.957595:0:5857:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788521644.957597:0:5857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521644.957601:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521644.957602:0:5857:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788521644.957605:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788521644.957637:0:5857:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1788521644.957684:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001a81088f pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5857:1875400816854272:0@lo:502: 00000100:00100000:3.0:1788521644.957758:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521644.957810:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set 0000000083e667e6 going to sleep for 11 seconds 00000100:00100000:1.0:1788521644.957889:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816854272 00000100:00100000:1.0:1788521644.957896:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816854272 00000100:00100000:1.0:1788521644.957937:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788521644.957945:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f234efd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+9:5857:x1875400816854272:12345-0@lo:502: 00000100:00100000:1.0:1788521644.958368:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f234efd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+9:5857:x1875400816854272:12345-0@lo:502: Request processed in 423us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521644.958376:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788521644.958590:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001a81088f pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5857:1875400816854272:0@lo:502: 00000020:01000000:3.0:1788521644.958613:0:5857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521644.958618:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521644.958621:0:5857:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1788521644.958624:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1788521644.961483:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1788521644.961514:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788521644.961533:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 000000001953258f/0x1b7b50db5927b968 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927b96f expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.961547:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 000000001953258f/0x1b7b50db5927b968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927b96f expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521644.961555:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff996f85616000 from 1 10000000:01000000:1.0:1788521644.961558:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788521644.961611:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 000000005f3d53b9/0x1b7b50db5927b9bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.961618:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 000000005f3d53b9/0x1b7b50db5927b9bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.961627:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 000000005f3d53b9/0x1b7b50db5927b9bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521644.961645:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006101da14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816854400:0@lo:101: 00000100:00100000:1.0:1788521644.961696:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521644.961731:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 0000000036130a89 going to sleep for 11 seconds 00000100:00100000:1.0:1788521644.961770:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816854400 00000100:00100000:1.0:1788521644.961777:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816854400 00000100:00100000:1.0:1788521644.961814:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788521644.961822:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022b62b43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+9:5814:x1875400816854400:12345-0@lo:101: 00010000:00010000:1.0:1788521644.961833:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521644.961843:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000057cf66cd/0x1b7b50db5927b9c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927b9bc expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.961862:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000057cf66cd/0x1b7b50db5927b9c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927b9bc expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.961871:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000057cf66cd/0x1b7b50db5927b9c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927b9bc expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.961878:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000057cf66cd, rc 0) 00000100:00100000:1.0:1788521644.961913:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022b62b43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+10:5814:x1875400816854400:12345-0@lo:101: Request processed in 92us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521644.961919:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788521644.961959:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006101da14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816854400:0@lo:101: 00010000:00010000:1.0:1788521644.961972:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 000000005f3d53b9/0x1b7b50db5927b9bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927b9c3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.961979:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 000000005f3d53b9/0x1b7b50db5927b9bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927b9c3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521644.962562:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006101da14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816854528:0@lo:256: 00000100:00100000:1.0:1788521644.962600:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521644.962616:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 0000000036130a89 going to sleep for 11 seconds 00000100:00100000:1.0:1788521644.962634:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816854528 00000100:00100000:1.0:1788521644.962646:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816854528 00000100:00100000:1.0:1788521644.962674:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788521644.962679:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000686af8c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+10:5814:x1875400816854528:12345-0@lo:256: 20000000:01000000:1.0:1788521644.962694:0:5827:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788521644.962699:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788521644.962757:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000686af8c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+10:5814:x1875400816854528:12345-0@lo:256: Request processed in 78us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521644.962764:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788521644.962796:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006101da14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816854528:0@lo:256: 10000000:01000000:1.0:1788521644.963391:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788521644.963398:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 000000005f3d53b9/0x1b7b50db5927b9bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927b9c3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.963419:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 000000005f3d53b9/0x1b7b50db5927b9bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927b9c3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521644.963427:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff996f85616000 from 1 10000000:01000000:1.0:1788521644.963429:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788521644.963452:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 00000000cb7185ef/0x1b7b50db5927b9ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.963459:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 00000000cb7185ef/0x1b7b50db5927b9ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.963466:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 00000000cb7185ef/0x1b7b50db5927b9ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521644.963479:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006101da14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816854656:0@lo:101: 00000100:00100000:1.0:1788521644.963509:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521644.963534:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 0000000036130a89 going to sleep for 11 seconds 00000100:00100000:1.0:1788521644.963551:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816854656 00000100:00100000:1.0:1788521644.963555:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816854656 00000100:00100000:1.0:1788521644.963581:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788521644.963587:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089fa5c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+10:5814:x1875400816854656:12345-0@lo:101: 00010000:00010000:1.0:1788521644.963595:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521644.963604:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002413e16b/0x1b7b50db5927b9d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927b9ca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.963620:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002413e16b/0x1b7b50db5927b9d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927b9ca expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.963629:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002413e16b/0x1b7b50db5927b9d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927b9ca expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.963636:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002413e16b, rc 0) 00000100:00100000:1.0:1788521644.963664:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089fa5c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+11:5814:x1875400816854656:12345-0@lo:101: Request processed in 77us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521644.963670:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788521644.963707:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006101da14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816854656:0@lo:101: 00010000:00010000:1.0:1788521644.963718:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 00000000cb7185ef/0x1b7b50db5927b9ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927b9d1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.963726:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 00000000cb7185ef/0x1b7b50db5927b9ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927b9d1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521644.963767:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006101da14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816854784:0@lo:501: 00000100:00100000:1.0:1788521644.963791:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521644.963804:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 0000000036130a89 going to sleep for 11 seconds 00000100:00100000:1.0:1788521644.963823:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816854784 00000100:00100000:1.0:1788521644.963826:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816854784 00000100:00100000:1.0:1788521644.963849:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788521644.963854:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003052830 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+11:5814:x1875400816854784:12345-0@lo:501: 00000100:00100000:1.0:1788521644.965727:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003052830 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+11:5814:x1875400816854784:12345-0@lo:501: Request processed in 1867us (1930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521644.965738:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788521644.967034:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006101da14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816854784:0@lo:501: 00000100:00100000:0.0:1788521644.967089:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004dc79abd pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816854912:0@lo:503: 00000100:00100000:0.0:1788521644.967266:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521644.967348:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 0000000046c1ba30 going to sleep for 11 seconds 00000100:00100000:3.0:1788521644.968532:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816854912 00000100:00100000:3.0:1788521644.968542:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816854912 00000100:00100000:3.0:1788521644.968927:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788521644.968938:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069dd97da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+11:5814:x1875400816854912:12345-0@lo:503: 00000040:00080000:3.0:1788521644.968992:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788521644.969069:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069dd97da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+11:5814:x1875400816854912:12345-0@lo:503: Request processed in 133us (1802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521644.969076:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788521644.969178:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004dc79abd pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816854912:0@lo:503: 00000040:00080000:0.0:1788521644.971226:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788521644.971444:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788521644.971461:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788521644.971477:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 00000000cb7185ef/0x1b7b50db5927b9ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927b9d1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.971488:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 00000000cb7185ef/0x1b7b50db5927b9ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927b9d1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521644.971525:0:5814:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788521644.971528:0:5814:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff996f85616000 10000000:01000000:1.0:1788521644.971531:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff996f85616000 10000000:01000000:1.0:1788521644.971534:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788521644.971539:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff996f85616000 from 1 10000000:01000000:1.0:1788521644.971541:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788521644.971572:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 0000000085d9fdaa/0x1b7b50db5927b9d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.971580:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 0000000085d9fdaa/0x1b7b50db5927b9d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.971588:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 0000000085d9fdaa/0x1b7b50db5927b9d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521644.971618:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000524fe5d1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816855040:0@lo:101: 00000100:00100000:1.0:1788521644.971674:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521644.971709:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a0c8fdb2 going to sleep for 11 seconds 00000100:00100000:1.0:1788521644.971729:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816855040 00000100:00100000:1.0:1788521644.971735:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816855040 00000100:00100000:1.0:1788521644.971770:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788521644.971777:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000998c532a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+11:5814:x1875400816855040:12345-0@lo:101: 00010000:00010000:1.0:1788521644.971788:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521644.971798:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003f248455/0x1b7b50db5927b9df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927b9d8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.971817:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003f248455/0x1b7b50db5927b9df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927b9d8 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.971826:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003f248455/0x1b7b50db5927b9df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927b9d8 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.971834:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003f248455, rc 0) 00000100:00100000:1.0:1788521644.971868:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000998c532a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:5814:x1875400816855040:12345-0@lo:101: Request processed in 91us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521644.971875:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788521644.971916:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000524fe5d1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816855040:0@lo:101: 00010000:00010000:1.0:1788521644.971928:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 0000000085d9fdaa/0x1b7b50db5927b9d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927b9df expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521644.971937:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 0000000085d9fdaa/0x1b7b50db5927b9d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927b9df expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521644.971991:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000524fe5d1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816855168:0@lo:501: 00000100:00100000:1.0:1788521644.972017:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521644.972027:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a0c8fdb2 going to sleep for 11 seconds 00000100:00100000:0.0:1788521644.972170:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816855168 00000100:00100000:0.0:1788521644.972175:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816855168 00000100:00100000:0.0:1788521644.972200:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788521644.972206:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070b5bfb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:5814:x1875400816855168:12345-0@lo:501: 00000100:00100000:0.0:1788521644.972570:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070b5bfb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:5814:x1875400816855168:12345-0@lo:501: Request processed in 364us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521644.972577:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788521644.972657:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000524fe5d1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816855168:0@lo:501: 00000100:00100000:1.0:1788521644.972683:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000524fe5d1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816855296:0@lo:503: 00000100:00100000:1.0:1788521644.972721:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521644.972743:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a0c8fdb2 going to sleep for 11 seconds 00000100:00100000:0.0:1788521644.972786:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816855296 00000100:00100000:0.0:1788521644.972791:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816855296 00000100:00100000:0.0:1788521644.972820:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788521644.972826:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005fbd4519 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:5814:x1875400816855296:12345-0@lo:503: 00000100:00100000:0.0:1788521644.974894:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005fbd4519 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:5814:x1875400816855296:12345-0@lo:503: Request processed in 2063us (2168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521644.974906:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788521644.975032:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000524fe5d1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816855296:0@lo:503: 00000100:00100000:0.0:1788521644.975844:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094a6393c pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5862:1875400816855424:0@lo:502: 00000100:00100000:0.0:1788521644.975892:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521644.976523:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set 0000000003c6ad42 going to sleep for 11 seconds 00000100:00100000:1.0:1788521644.976576:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816855424 00000100:00100000:1.0:1788521644.976583:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816855424 00000100:00100000:1.0:1788521644.976633:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788521644.976641:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011110e5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:5862:x1875400816855424:12345-0@lo:502: 00000100:00100000:1.0:1788521644.976894:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011110e5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:5862:x1875400816855424:12345-0@lo:502: Request processed in 254us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521644.976903:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788521644.977048:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094a6393c pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5862:1875400816855424:0@lo:502: 00000020:01000004:0.0:1788521644.977102:0:5862:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788521644.977125:0:5862:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000009953d6a3) 00000020:00000080:0.0:1788521644.977175:0:5862:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788521644.977251:0:5862:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000036923fbd from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788521644.977255:0:5862:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000036923fbd from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788521644.977257:0:5862:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000036923fbd 4 00010000:00080000:0.0:1788521644.977302:0:5862:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009070c1fb@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.148@tcp at head 00010000:00010000:1.0:1788521644.980215:0:5862:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1788521644.981702:0:5862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788521644.981744:0:5862:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788521644.981756:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1b7b50db5927b9ed 00000100:00080000:1.0:1788521644.981766:0:5862:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788521644.981771:0:5862:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009070c1fb using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1788521644.981804:0:5862:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fb5ccadd x1875400816855552/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788521644.981876:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fb5ccadd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400816855552:0@lo:38: 00000100:00100000:2.0:1788521644.981954:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521644.982053:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816855552 00000100:00100000:3.0:1788521644.982061:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816855552 00000100:00100000:3.0:1788521644.982094:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788521644.982100:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb44b6ce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875400816855552:12345-0@lo:38: 00000100:00080000:1.0:1788521644.984290:0:5862:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788521644.986547:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb44b6ce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875400816855552:12345-0@lo:38: Request processed in 4438us (4585us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788521644.986561:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788521644.986717:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788521644.986725:0:3303:0:(import.c:65:import_set_state_nolock()) 000000009070c1fb lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788521644.986730:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788521644.986733:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fb5ccadd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400816855552:0@lo:38: 00000100:00100000:1.0:1788521644.986925:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e774f85c pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5862:1875400816855680:0@lo:502: 00000100:00100000:1.0:1788521644.986999:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521644.987046:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set 000000009db935f9 going to sleep for 11 seconds 00000100:00100000:3.0:1788521644.987658:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816855680 00000100:00100000:3.0:1788521644.987666:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816855680 00000100:00100000:3.0:1788521644.987709:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788521644.987716:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d20d9f5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:5862:x1875400816855680:12345-0@lo:502: 00000100:00100000:3.0:1788521644.987937:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d20d9f5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:5862:x1875400816855680:12345-0@lo:502: Request processed in 221us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521644.987945:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788521644.987994:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e774f85c pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5862:1875400816855680:0@lo:502: 00000040:00080000:3.0:1788521644.988020:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788521644.988133:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788521644.988185:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788521644.988196:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 0000000085d9fdaa/0x1b7b50db5927b9d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927b9df expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521644.988206:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 0000000085d9fdaa/0x1b7b50db5927b9d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927b9df expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788521644.988254:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788521644.988256:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788521644.988257:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521644.988258:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521644.988259:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521644.988261:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521644.988262:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788521644.988263:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788521644.988264:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788521644.988266:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788521644.988267:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521644.988269:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788521644.988272:0:5814:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788521644.988275:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788521644.988276:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788521644.988277:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521644.988278:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521644.988279:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521644.988280:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521644.988281:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788521644.988282:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788521644.988283:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788521644.988284:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788521644.988285:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521644.988286:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788521644.988606:0:5814:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788521644.988618:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c26ae1f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816855808:0@lo:253: 00000100:00100000:2.0:1788521644.988656:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521644.988687:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000955dfef7 going to sleep for 11 seconds 00000100:00100000:0.0:1788521644.988733:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816855808 00000100:00100000:0.0:1788521644.988739:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816855808 00000100:00100000:0.0:1788521644.988772:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788521644.988780:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077ed54e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:5814:x1875400816855808:12345-0@lo:253: 20000000:01000000:0.0:1788521644.988798:0:5826:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788521644.988809:0:5826:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788521645.038462:0:5826:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788521645.038481:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788521645.038649:0:5849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788521645.038654:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788521645.038674:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000078ac0797/0x1b7b50db5927b9f4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521645.038692:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000057cf66cd/0x1b7b50db5927b9c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927b9bc expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521645.038700:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000078ac0797/0x1b7b50db5927b9f4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521645.038738:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000057cf66cd/0x1b7b50db5927b9c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927b9bc expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521645.038751:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000057cf66cd/0x1b7b50db5927b9c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927b9bc expref: 12 pid: 5828 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521645.038763:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000483e8856 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1875400816855936:0@lo:104: 00000100:00100000:1.0:1788521645.038818:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521645.038874:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1a54c6f going to sleep for 11 seconds 00000100:00100000:0.0:1788521645.038937:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816855936 00000100:00100000:0.0:1788521645.038945:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816855936 00000100:00100000:0.0:1788521645.038994:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788521645.039002:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c856c1a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+3:5849:x1875400816855936:12345-0@lo:104: 00010000:00010000:0.0:1788521645.039014:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: 000000005f3d53b9/0x1b7b50db5927b9bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927b9c3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521645.039067:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788521645.039084:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c856c1a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+3:5849:x1875400816855936:12345-0@lo:104: Request processed in 83us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521645.039091:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788521645.039124:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521645.039129:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: 000000005f3d53b9/0x1b7b50db5927b9bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927b9c3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521645.039135:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005f3d53b9 already unused, calling callback (0000000071bad465) 10000000:00010000:0.0:1788521645.039138:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: 000000005f3d53b9/0x1b7b50db5927b9bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927b9c3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521645.039167:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: 000000005f3d53b9/0x1b7b50db5927b9bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927b9c3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521645.039173:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: 000000005f3d53b9/0x1b7b50db5927b9bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927b9c3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521645.039177:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521645.039204:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: 000000005f3d53b9/0x1b7b50db5927b9bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927b9c3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521645.039210:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521645.039225:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: 000000005f3d53b9/0x1b7b50db5927b9bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927b9c3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521645.039230:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: 000000005f3d53b9/0x1b7b50db5927b9bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927b9c3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521645.039244:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521645.039245:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521645.039247:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521645.039319:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094a6393c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3305:1875400816856064:0@lo:103: 00000100:00100000:0.0:1788521645.039535:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521645.039603:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816856064 00000100:00100000:0.0:1788521645.039608:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816856064 00010000:00010000:0.0:1788521645.039624:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000057cf66cd/0x1b7b50db5927b9c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927b9bc expref: 13 pid: 5828 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521645.039646:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788521645.039652:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000902247f0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:3305:x1875400816856064:12345-0@lo:103: 00010000:00010000:0.0:1788521645.039661:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521645.039664:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000057cf66cd/0x1b7b50db5927b9c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927b9bc expref: 13 pid: 5828 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521645.039672:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000057cf66cd/0x1b7b50db5927b9c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927b9bc expref: 13 pid: 5828 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521645.039685:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000078ac0797/0x1b7b50db5927b9f4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521645.039691:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000078ac0797/0x1b7b50db5927b9f4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788521645.039701:0:5818:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001047872s 00010000:00010000:0.0:1788521645.039704:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000078ac0797/0x1b7b50db5927b9f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521645.039709:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000078ac0797/0x1b7b50db5927b9f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521645.039714:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000078ac0797/0x1b7b50db5927b9f4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521645.039729:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000078ac0797/0x1b7b50db5927b9f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521645.039734:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000078ac0797 already unused, calling callback (0000000086fe2ae6) 00010000:00010000:0.0:1788521645.039737:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000078ac0797/0x1b7b50db5927b9f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521645.039743:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000078ac0797/0x1b7b50db5927b9f4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521645.039750:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000078ac0797/0x1b7b50db5927b9f4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521645.039759:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521645.039787:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000902247f0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:3305:x1875400816856064:12345-0@lo:103: Request processed in 136us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521645.039794:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788521645.039825:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094a6393c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3305:1875400816856064:0@lo:103: 00010000:00010000:0.0:1788521645.039853:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000057cf66cd/0x1b7b50db5927b9c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927b9bc expref: 12 pid: 5828 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521645.039865:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000483e8856 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1875400816855936:0@lo:104: 00010000:00010000:0.0:1788521645.039874:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000078ac0797/0x1b7b50db5927b9f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521645.039881:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000078ac0797/0x1b7b50db5927b9f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521645.039886:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000078ac0797/0x1b7b50db5927b9f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521645.039898:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000078ac0797/0x1b7b50db5927b9f4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521645.047933:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077ed54e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+11:5814:x1875400816855808:12345-0@lo:253: Request processed in 59147us (59269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521645.047948:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788521645.048023:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c26ae1f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5814:1875400816855808:0@lo:253: 10000000:01000000:3.0:1788521645.048038:0:5814:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788521645.048041:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788521645.048043:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788521645.048044:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788521645.048045:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788521645.048046:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788521645.048047:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788521645.048048:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788521645.048050:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788521645.048051:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788521645.048052:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788521645.048054:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788521645.048056:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788521645.048081:0:5814:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788521645.057023:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788521645.057763:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788521645.057984:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788521645.058652:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788521645.058887:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788521645.059059:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788521645.059972:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788521645.060578:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788521645.060812:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788521645.060977:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788521645.061227:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788521645.061498:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1788521645.127129:0:5814:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1788521645.183237:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788521645.183354:0:5867:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788521645.183358:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788521645.183529:0:5868:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788521645.186168:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788521645.186335:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788521645.186765:0:5814:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788521645.186772:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788521645.186917:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788521645.188337:0:5814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788521645.188999:0:5814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788521645.189030:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788521645.190337:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788521645.190661:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1788521645.195099:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788521645.195568:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788521645.195705:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788521645.196081:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788521645.196456:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788521645.196680:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788521645.196935:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788521645.197644:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788521645.197780:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788521645.198228:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788521645.198601:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788521645.198738:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00010000:00010000:0.0:1788521645.198963:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788521645.199068:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788521645.199458:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788521645.199679:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788521645.200057:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788521645.200672:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788521645.201091:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788521645.201950:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788521645.202927:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788521645.203241:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788521645.204200:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788521645.204931:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788521645.206079:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788521645.206983:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788521645.207642:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788521645.207846:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788521645.207984:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788521645.208177:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788521645.210042:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788521645.210980:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788521645.212185:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788521645.212721:0:5814:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1788521645.219079:0:5868:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788521645.266978:0:5868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788521645.267050:0:5868:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788521645.267055:0:5868:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:3.0:1788521645.267593:0:5814:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788521645.267616:0:5814:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffac0d01a07988 00100000:10000000:3.0:1788521645.267623:0:5814:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788521645.268328:0:5814:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788521645.268341:0:5814:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.148@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788521645.268356:0:5814:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788521645.268378:0:5814:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788521646.222237:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521647.246782:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521648.275056:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521649.295043:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788521649.489595:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788521649.489606:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff996f85616000 from 3 10000000:01000000:0.0:1788521649.489613:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788521649.489679:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 00000000ae148880/0x1b7b50db5927b9fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521649.489694:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 00000000ae148880/0x1b7b50db5927b9fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521649.489708:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 00000000ae148880/0x1b7b50db5927b9fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521649.489740:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094a6393c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816856192:0@lo:101: 00000100:00100000:0.0:1788521649.489836:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521649.489897:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 0000000080ccbfeb going to sleep for 11 seconds 00000100:00100000:2.0:1788521649.490571:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816856192 00000100:00100000:2.0:1788521649.490602:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816856192 00000100:00100000:2.0:1788521649.490676:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788521649.490686:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000549b0289 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+11:5830:x1875400816856192:12345-0@lo:101: 00010000:00010000:2.0:1788521649.490702:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521649.490719:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e4dd5197/0x1b7b50db5927ba02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927b9fb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521649.490751:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e4dd5197/0x1b7b50db5927ba02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927b9fb expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521649.490763:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e4dd5197/0x1b7b50db5927ba02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927b9fb expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521649.490774:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e4dd5197, rc 0) 00000100:00100000:2.0:1788521649.490835:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000549b0289 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:5830:x1875400816856192:12345-0@lo:101: Request processed in 152us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521649.490842:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788521649.490944:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094a6393c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816856192:0@lo:101: 00010000:00010000:0.0:1788521649.490966:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 00000000ae148880/0x1b7b50db5927b9fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927ba02 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521649.490974:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 00000000ae148880/0x1b7b50db5927b9fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927ba02 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521649.491056:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094a6393c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816856320:0@lo:256: 00000100:00100000:0.0:1788521649.491093:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521649.491120:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 0000000080ccbfeb going to sleep for 11 seconds 00000100:00100000:2.0:1788521649.491831:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816856320 00000100:00100000:2.0:1788521649.491841:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816856320 00000100:00100000:2.0:1788521649.491898:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788521649.491906:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001298cfb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:5830:x1875400816856320:12345-0@lo:256: 20000000:01000000:2.0:1788521649.491932:0:5826:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788521649.491952:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788521649.491956:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788521649.492061:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001298cfb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:5830:x1875400816856320:12345-0@lo:256: Request processed in 156us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521649.492069:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788521649.492193:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094a6393c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816856320:0@lo:256: 10000000:01000000:0.0:1788521649.492254:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788521649.492264:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 00000000ae148880/0x1b7b50db5927b9fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927ba02 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521649.492274:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 00000000ae148880/0x1b7b50db5927b9fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927ba02 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:3.0:1788521649.998713:0:6111:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1788521649.999177:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788521649.999185:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788521649.999198:0:475:0:(import.c:65:import_set_state_nolock()) 000000009070c1fb lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788521649.999213:0:475:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009070c1fb using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1788521649.999263:0:475:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006b2a9bb6 x1875400816856448/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788521649.999400:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b2a9bb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400816856448:0@lo:38: 00000100:00100000:1.0:1788521649.999499:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521649.999716:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816856448 00000100:00100000:2.0:1788521649.999727:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816856448 00000100:00100000:2.0:1788521649.999778:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788521649.999785:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000456c1ae2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1875400816856448:12345-0@lo:38: 00010000:00080000:2.0:1788521649.999818:0:5835:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 149 last 0 00000020:00000080:2.0:1788521649.999862:0:5835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1b7b50db5927ba09 00000004:00100000:2.0:1788521649.999918:0:5835:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788521650.000061:0:5835:0:(import.c:65:import_set_state_nolock()) 0000000038887189 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788521650.000121:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000456c1ae2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400816856448:12345-0@lo:38: Request processed in 335us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521650.000128:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788521650.000316:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006b2a9bb6 x1875400816856448/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788521659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788521650.000335:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788521650.000343:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788521650.000348:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788521650.000351:0:3303:0:(import.c:65:import_set_state_nolock()) 000000009070c1fb lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788521650.000356:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b2a9bb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400816856448:0@lo:38: 00010000:00010000:0.0:1788521650.318402:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521651.345998:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521652.366522:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521653.391349:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521654.414283:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788521654.677442:0:6313:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7ace70c0 20000000:00000080:0.0:1788521654.677458:0:6313:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff996fb4498400 uarg=0000000000000000 20000000:01000000:0.0:1788521654.677489:0:6313:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788521654.677496:0:6313:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788521654.677500:0:6313:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788521654.677750:0:6313:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788521654.677760:0:6313:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788521654.688415:0:6313:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788521654.689091:0:6313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788521654.689252:0:6313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788521654.689321:0:6313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788521654.689342:0:6313:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788521654.689368:0:6313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005f3d53b9/0x1b7b50db5927ba10 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521654.689394:0:6313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002413e16b/0x1b7b50db5927b9d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927b9ca expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521654.689401:0:6313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005f3d53b9/0x1b7b50db5927ba10 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521654.689437:0:6313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002413e16b/0x1b7b50db5927b9d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927b9ca expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521654.689450:0:6313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002413e16b/0x1b7b50db5927b9d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927b9ca expref: 11 pid: 5827 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521654.689474:0:6313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000c1d622f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6313:1875400816856576:0@lo:104: 00000100:00100000:1.0:1788521654.689541:0:6313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521654.689587:0:6313:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017ca6ce3 going to sleep for 11 seconds 00000100:00100000:0.0:1788521654.689885:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816856576 00000100:00100000:0.0:1788521654.689893:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816856576 00000100:00100000:0.0:1788521654.689935:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788521654.689943:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000eeb283d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+3:6313:x1875400816856576:12345-0@lo:104: 00010000:00010000:0.0:1788521654.689962:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: 00000000cb7185ef/0x1b7b50db5927b9ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927b9d1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521654.690015:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788521654.690020:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000eeb283d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+3:6313:x1875400816856576:12345-0@lo:104: Request processed in 79us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521654.690027:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788521654.690047:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521654.690052:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: 00000000cb7185ef/0x1b7b50db5927b9ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927b9d1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521654.690059:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cb7185ef already unused, calling callback (0000000071bad465) 10000000:00010000:0.0:1788521654.690062:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: 00000000cb7185ef/0x1b7b50db5927b9ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927b9d1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521654.690069:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: 00000000cb7185ef/0x1b7b50db5927b9ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927b9d1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521654.690075:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: 00000000cb7185ef/0x1b7b50db5927b9ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927b9d1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521654.690079:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788521654.690106:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: 00000000cb7185ef/0x1b7b50db5927b9ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927b9d1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521654.690113:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521654.690127:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: 00000000cb7185ef/0x1b7b50db5927b9ca lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927b9d1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521654.690133:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: 00000000cb7185ef/0x1b7b50db5927b9ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927b9d1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521654.690173:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521654.690174:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521654.690175:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521654.690238:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788521654.690246:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094a6393c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816856704:0@lo:103: 00000100:00100000:0.0:1788521654.690275:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521654.690305:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816856704 00000100:00100000:0.0:1788521654.690309:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816856704 00010000:00010000:0.0:1788521654.690324:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002413e16b/0x1b7b50db5927b9d1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927b9ca expref: 12 pid: 5827 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521654.690343:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788521654.690349:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087b98a56 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:3307:x1875400816856704:12345-0@lo:103: 00010000:00010000:0.0:1788521654.690369:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521654.690373:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002413e16b/0x1b7b50db5927b9d1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927b9ca expref: 12 pid: 5827 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521654.690488:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002413e16b/0x1b7b50db5927b9d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927b9ca expref: 12 pid: 5827 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521654.690502:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005f3d53b9/0x1b7b50db5927ba10 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521654.690508:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005f3d53b9/0x1b7b50db5927ba10 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521654.690519:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005f3d53b9/0x1b7b50db5927ba10 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521654.690534:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005f3d53b9/0x1b7b50db5927ba10 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521654.690539:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005f3d53b9/0x1b7b50db5927ba10 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521654.690543:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005f3d53b9/0x1b7b50db5927ba10 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521654.690547:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005f3d53b9 already unused, calling callback (0000000086fe2ae6) 00010000:00010000:0.0:1788521654.690550:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005f3d53b9/0x1b7b50db5927ba10 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521654.690555:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005f3d53b9/0x1b7b50db5927ba10 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521654.690562:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005f3d53b9/0x1b7b50db5927ba10 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521654.690571:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521654.690595:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087b98a56 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:3307:x1875400816856704:12345-0@lo:103: Request processed in 247us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521654.690601:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788521654.690872:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094a6393c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816856704:0@lo:103: 00010000:00010000:1.0:1788521654.690988:0:6313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002413e16b/0x1b7b50db5927b9d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927b9ca expref: 11 pid: 5827 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521654.690998:0:6313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000c1d622f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6313:1875400816856576:0@lo:104: 00010000:00010000:1.0:1788521654.691010:0:6313:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005f3d53b9/0x1b7b50db5927ba10 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521654.691018:0:6313:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005f3d53b9/0x1b7b50db5927ba10 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521654.691022:0:6313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005f3d53b9/0x1b7b50db5927ba10 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521654.691027:0:6313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005f3d53b9/0x1b7b50db5927ba10 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521654.782347:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788521654.782384:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff996f85616000 from 1 10000000:01000000:0.0:1788521654.782389:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788521654.782430:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 000000004383965f/0x1b7b50db5927ba17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521654.782451:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 000000004383965f/0x1b7b50db5927ba17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521654.782460:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 000000004383965f/0x1b7b50db5927ba17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521654.782482:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094a6393c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816856832:0@lo:101: 00000100:00100000:0.0:1788521654.782541:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521654.782627:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 0000000059035a8f going to sleep for 11 seconds 00000100:00100000:1.0:1788521654.784638:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816856832 00000100:00100000:1.0:1788521654.784649:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816856832 00000100:00100000:1.0:1788521654.784706:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788521654.784756:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032e436c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+11:5830:x1875400816856832:12345-0@lo:101: 00010000:00010000:1.0:1788521654.784771:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521654.784786:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005f3d53b9/0x1b7b50db5927ba1e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927ba17 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521654.785022:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005f3d53b9/0x1b7b50db5927ba1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927ba17 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521654.785040:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005f3d53b9/0x1b7b50db5927ba1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927ba17 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521654.785048:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005f3d53b9, rc 0) 00000100:00100000:1.0:1788521654.785120:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032e436c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:5830:x1875400816856832:12345-0@lo:101: Request processed in 367us (2578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521654.785126:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788521654.785203:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094a6393c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816856832:0@lo:101: 00010000:00010000:3.0:1788521654.785225:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 000000004383965f/0x1b7b50db5927ba17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927ba1e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521654.785232:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 000000004383965f/0x1b7b50db5927ba17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927ba1e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521654.785293:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001a81088f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816856960:0@lo:501: 00000100:00100000:3.0:1788521654.785326:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521654.785369:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da742fb6 going to sleep for 11 seconds 00000100:00100000:0.0:1788521654.785450:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816856960 00000100:00100000:0.0:1788521654.785454:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816856960 00000100:00100000:0.0:1788521654.785692:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788521654.785700:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009880c188 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:5830:x1875400816856960:12345-0@lo:501: 00000100:00100000:0.0:1788521654.785940:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009880c188 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:5830:x1875400816856960:12345-0@lo:501: Request processed in 241us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521654.785947:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788521654.786001:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001a81088f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816856960:0@lo:501: 00000100:00100000:1.0:1788521654.786028:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000c1d622f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816857088:0@lo:503: 00000100:00100000:1.0:1788521654.786063:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521654.786575:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dfeeca47 going to sleep for 11 seconds 00000100:00100000:3.0:1788521654.788056:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816857088 00000100:00100000:3.0:1788521654.788067:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816857088 00000100:00100000:3.0:1788521654.788108:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788521654.788116:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000374b40a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:5830:x1875400816857088:12345-0@lo:503: 00000100:00100000:3.0:1788521654.788305:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000374b40a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:5830:x1875400816857088:12345-0@lo:503: Request processed in 190us (2241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521654.788312:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788521654.790556:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000c1d622f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816857088:0@lo:503: 00000100:00100000:2.0:1788521654.790824:0:6321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000010b45b16 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6321:1875400816857216:0@lo:502: 00000100:00100000:2.0:1788521654.790899:0:6321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521654.790929:0:6321:0:(client.c:2716:ptlrpc_set_wait()) set 000000004d33852d going to sleep for 11 seconds 00000100:00100000:3.0:1788521654.791125:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816857216 00000100:00100000:3.0:1788521654.791131:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816857216 00000100:00100000:3.0:1788521654.791176:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788521654.791184:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023abace3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:6321:x1875400816857216:12345-0@lo:502: 00000100:00100000:3.0:1788521654.791348:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023abace3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:6321:x1875400816857216:12345-0@lo:502: Request processed in 165us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521654.791366:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788521654.791373:0:6321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000010b45b16 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6321:1875400816857216:0@lo:502: 00000020:01000000:2.0:1788521654.791393:0:6321:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521654.791402:0:6321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521654.791404:0:6321:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788521654.791411:0:6321:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff996f85616000 00000020:00000080:2.0:1788521654.791414:0:6321:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788521654.791451:0:6321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860db100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6321:1875400816857344:0@lo:502: 00000100:00100000:2.0:1788521654.791489:0:6321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521654.791503:0:6321:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb18d79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521654.791605:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816857344 00000100:00100000:3.0:1788521654.791609:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816857344 00000100:00100000:3.0:1788521654.791625:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788521654.791631:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:6321:x1875400816857344:12345-0@lo:502: 00000100:00100000:3.0:1788521654.791732:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:6321:x1875400816857344:12345-0@lo:502: Request processed in 101us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521654.791739:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788521654.792828:0:6321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860db100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6321:1875400816857344:0@lo:502: 00000020:01000000:2.0:1788521654.792856:0:6321:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521654.792862:0:6321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521654.792864:0:6321:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788521654.792868:0:6321:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788521654.793027:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788521654.793047:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788521654.793056:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927ba17 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927ba1e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521654.793067:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927ba17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927ba1e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521655.118831:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788521655.118857:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f8574b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875400816857600:0@lo:400: 00000100:00100000:3.0:1788521655.118927:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521655.119003:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816857600 00000100:00100000:2.0:1788521655.119012:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816857600 00000100:00100000:1.0:1788521655.119106:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788521655.119118:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f8574b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816857472:0@lo:400: 00000100:00100000:1.0:1788521655.119172:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521655.119211:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788521655.119223:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875400816857600:12345-0@lo:400: 00000100:00100000:1.0:1788521655.119225:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816857472 00000100:00100000:1.0:1788521655.119231:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816857472 00000100:00100000:1.0:1788521655.119261:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788521655.119270:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:3306:x1875400816857472:12345-0@lo:400: 00000100:00100000:2.0:1788521655.119289:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875400816857600:12345-0@lo:400: Request processed in 69us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521655.119299:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788521655.119314:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:3306:x1875400816857472:12345-0@lo:400: Request processed in 45us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521655.119406:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f8574b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816857472:0@lo:400: 00000100:00100000:1.0:1788521655.119448:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1788521655.126527:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff996f8574b100 x1875400816857600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521655.126548:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f8574b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875400816857600:0@lo:400: 00010000:00010000:0.0:1788521655.438908:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521656.462389:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521657.496105:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521658.517476:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521659.535582:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521660.238377:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3305:1875400816857728:0@lo:400: 00000100:00100000:3.0:1788521660.238444:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521660.238545:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816857728 00000100:00100000:1.0:1788521660.238553:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816857728 00000100:00100000:1.0:1788521660.238600:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788521660.238609:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:3305:x1875400816857728:12345-0@lo:400: 00000100:00100000:1.0:1788521660.238665:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:3305:x1875400816857728:12345-0@lo:400: Request processed in 57us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521660.238672:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788521660.238759:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3305:1875400816857728:0@lo:400: 00000100:00100000:0.0:1788521660.240531:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875400816857856:0@lo:400: 00000100:00100000:0.0:1788521660.240597:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521660.241037:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816857856 00000100:00100000:1.0:1788521660.241045:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816857856 00000100:00100000:1.0:1788521660.241098:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788521660.241106:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875400816857856:12345-0@lo:400: 00000100:00100000:1.0:1788521660.241192:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875400816857856:12345-0@lo:400: Request processed in 86us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521660.241200:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788521660.241336:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff996f98070000 x1875400816857856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521660.241351:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875400816857856:0@lo:400: 00010000:00010000:1.0:1788521660.558664:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788521660.773270:0:6685:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788521660.773274:0:6685:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788521660.773410:0:6685:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff996f97fff000 00000020:01000004:1.0:1788521660.773425:0:6685:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788521660.773436:0:6685:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788521660.773449:0:6685:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff996f90f199c0) 00000020:00000080:1.0:1788521660.773465:0:6685:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788521660.790824:0:6685:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788521660.791169:0:6685:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788521660.848207:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788521660.859023:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788521660.859058:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788521660.859117:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788521660.859164:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788521660.871931:0:6685:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788521660.871947:0:6685:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788521660.871960:0:6685:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1b7b50db5927ba2c 00000020:01000004:2.0:1788521660.871968:0:6685:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788521660.871990:0:6685:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.148@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788521660.871994:0:6685:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788521660.871999:0:6685:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788521660.872003:0:6685:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788521660.872041:0:6685:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff996fad7e0000) 00000020:00000080:2.0:1788521660.872055:0:6685:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788521660.873203:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788521660.873388:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788521660.873395:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788521660.884014:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788521660.884031:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788521660.884639:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788521660.884655:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788521660.888293:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788521660.890560:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788521660.890567:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788521660.900291:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788521660.900303:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788521660.961766:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788521660.962670:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788521660.962677:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788521660.974112:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788521660.974132:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788521660.975754:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788521660.975766:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788521660.979024:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788521660.979310:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788521660.979316:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788521660.985064:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788521660.985077:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788521661.089457:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788521661.089727:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788521661.089749:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788521661.097651:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788521661.097666:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788521661.098288:0:6685:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788521661.098312:0:6685:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788521661.098327:0:6685:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.148@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788521661.139489:0:6685:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.148@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788521661.139534:0:6685:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.148@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788521661.139538:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788521661.139540:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788521661.139541:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521661.139542:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521661.139543:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521661.139544:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521661.139546:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788521661.139547:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788521661.139548:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788521661.139550:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521661.139551:0:6685:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788521661.139554:0:6685:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788521661.139557:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788521661.139558:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788521661.139559:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521661.139560:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521661.139561:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521661.139563:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521661.139564:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788521661.139564:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788521661.139565:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788521661.139566:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521661.139567:0:6685:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788521661.139592:0:6685:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788521661.139609:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816857984:0@lo:253: 00000100:00100000:2.0:1788521661.139674:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521661.139747:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86741300 going to sleep for 11 seconds 00000100:00100000:1.0:1788521661.142550:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816857984 00000100:00100000:1.0:1788521661.142565:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816857984 00000100:00100000:1.0:1788521661.142623:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788521661.142633:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:6685:x1875400816857984:12345-0@lo:253: 20000000:01000000:1.0:1788521661.142683:0:5826:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788521661.142687:0:5826:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788521661.142699:0:5826:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788521661.142702:0:5826:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788521661.143597:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788521661.143801:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788521661.143814:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788521661.143851:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1788521661.143859:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788521661.143890:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1788521661.143937:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1788521661.144328:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788521661.144348:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.148@tcp 20000000:01000000:1.0:1788521661.144350:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.148@tcp (null) (null) (null) 00000040:00080000:1.0:1788521661.144385:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788521661.144392:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788521661.144445:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788521661.144454:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.148@tcp (null) (null) 00000040:00080000:1.0:1788521661.144484:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788521661.144491:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788521661.144516:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788521661.144573:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1788521661.145200:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788521661.145215:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.148@tcp 20000000:01000000:1.0:1788521661.145217:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.148@tcp (null) (null) (null) 00000040:00080000:1.0:1788521661.145253:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788521661.145261:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788521661.145293:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788521661.145300:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.148@tcp (null) (null) 00000040:00080000:0.0:1788521661.150818:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788521661.150845:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788521661.150883:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1788521661.150919:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1788521661.150941:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788521661.150943:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788521661.150949:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788521661.150951:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788521661.150953:0:5826:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788521661.150965:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788521661.150967:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788521661.151007:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788521661.151010:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788521661.151669:0:6700:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788521661.151728:0:6700:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788521661.151786:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788521661.160372:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1788521661.160439:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1788521661.160475:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1788521661.160490:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788521661.160493:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788521661.161136:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1788521661.161482:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1788521661.161523:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1788521661.161579:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1788521661.161591:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788521661.161593:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788521661.162043:0:6702:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788521661.162089:0:6702:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788521661.162174:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788521661.162491:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788521661.162526:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788521661.162572:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:3.0:1788521661.162588:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788521661.162608:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996f8392d800/0x1b7b50db5927ba3a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.162626:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996f829d4e00/0x1b7b50db5927b953 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927b94c expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.162633:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996f829d4200/0x1b7b50db5927b96f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927b968 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.162651:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996f829d4400/0x1b7b50db5927b9df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927b9d8 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.162658:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996f8392d800/0x1b7b50db5927ba3a lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.162699:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996f829d4400/0x1b7b50db5927b9df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927b9d8 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.162719:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996f829d4400/0x1b7b50db5927b9df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927b9d8 expref: 12 pid: 5827 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521661.162733:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f8574b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1875400816858112:0@lo:104: 00000100:00100000:3.0:1788521661.162791:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788521661.162854:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996f829d4200/0x1b7b50db5927b96f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927b968 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.162862:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996f829d4200/0x1b7b50db5927b96f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927b968 expref: 12 pid: 5826 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521661.162870:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f8574a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1875400816858240:0@lo:104: 00000100:00100000:3.0:1788521661.162891:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788521661.162921:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996f829d4e00/0x1b7b50db5927b953 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927b94c expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.162929:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996f829d4e00/0x1b7b50db5927b953 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927b94c expref: 12 pid: 5826 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521661.162938:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85749f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1875400816858368:0@lo:104: 00000100:00100000:3.0:1788521661.162975:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521661.162986:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f93626000 going to sleep for 11 seconds 00000100:00100000:0.0:1788521661.163105:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816858112 00000100:00100000:0.0:1788521661.163112:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816858112 00000100:00100000:0.0:1788521661.163195:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816858240 00000100:00100000:0.0:1788521661.163198:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816858240 00000100:00100000:0.0:1788521661.163345:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816858368 00000100:00100000:0.0:1788521661.163349:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816858368 00000100:00100000:0.0:1788521661.163364:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521661.163372:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85748e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+5:5826:x1875400816858112:12345-0@lo:104: 00010000:00010000:0.0:1788521661.163383:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996f829d5c00/0x1b7b50db5927b9d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927b9df expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521661.163605:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f8574b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1875400816858112:0@lo:104: 00010000:00010000:0.0:1788521661.163636:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788521661.163643:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85748e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+5:5826:x1875400816858112:12345-0@lo:104: Request processed in 272us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521661.163649:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521661.163666:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521661.163672:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85748700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+4:5826:x1875400816858240:12345-0@lo:104: 00010000:00010000:0.0:1788521661.163681:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996f80030200/0x1b7b50db5927b968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927b96f expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521661.163774:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f8574a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1875400816858240:0@lo:104: 00010000:00010000:2.0:1788521661.170447:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788521661.170476:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f829d5c00/0x1b7b50db5927b9d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927b9df expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521661.170486:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d5c00 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:2.0:1788521661.170490:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f829d5c00/0x1b7b50db5927b9d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927b9df expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521661.170500:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f829d5c00/0x1b7b50db5927b9d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927b9df expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521661.170507:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f829d5c00/0x1b7b50db5927b9d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927b9df expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521661.170513:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788521661.170556:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f829d5c00/0x1b7b50db5927b9d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927b9df expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521661.170563:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521661.170588:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f829d5c00/0x1b7b50db5927b9d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927b9df expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521661.170596:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f829d5c00/0x1b7b50db5927b9d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927b9df expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521661.170624:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521661.170628:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f80030200/0x1b7b50db5927b968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927b96f expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521661.170633:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80030200 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:2.0:1788521661.170636:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f80030200/0x1b7b50db5927b968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927b96f expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521661.170653:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f80030200/0x1b7b50db5927b968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927b96f expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521661.170659:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f80030200/0x1b7b50db5927b968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927b96f expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521661.170664:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788521661.170677:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f80030200/0x1b7b50db5927b968 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927b96f expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521661.170682:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521661.170712:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f80030200/0x1b7b50db5927b968 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927b96f expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521661.170718:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f80030200/0x1b7b50db5927b968 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927b96f expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521661.170728:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521661.170730:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521661.170732:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521661.171265:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816858496:0@lo:103: 00000100:00100000:2.0:1788521661.171467:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521661.171535:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816858624:0@lo:103: 00000100:00100000:2.0:1788521661.171558:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521661.172327:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816858496 00000100:00100000:3.0:1788521661.172336:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816858496 00010000:00010000:3.0:1788521661.172367:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996f829d4400/0x1b7b50db5927b9df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927b9d8 expref: 13 pid: 5827 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521661.172407:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816858624 00000100:00100000:3.0:1788521661.172411:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816858624 00010000:00010000:3.0:1788521661.172424:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996f829d4200/0x1b7b50db5927b96f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927b968 expref: 14 pid: 5826 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521661.172437:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788521661.172445:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:3307:x1875400816858496:12345-0@lo:103: 00010000:00010000:3.0:1788521661.172458:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521661.172463:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996f829d4400/0x1b7b50db5927b9df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927b9d8 expref: 14 pid: 5827 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.172480:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996f829d4400/0x1b7b50db5927b9df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927b9d8 expref: 14 pid: 5827 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.172496:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f829d4400/0x1b7b50db5927b9df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927b9d8 expref: 14 pid: 5827 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.172512:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521661.172557:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:3307:x1875400816858496:12345-0@lo:103: Request processed in 112us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521661.172564:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788521661.172592:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788521661.172597:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:3304:x1875400816858624:12345-0@lo:103: 00010000:00010000:3.0:1788521661.172605:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521661.172609:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996f829d4200/0x1b7b50db5927b96f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927b968 expref: 12 pid: 5826 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.172618:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996f829d4200/0x1b7b50db5927b96f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927b968 expref: 12 pid: 5826 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.172628:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f829d4200/0x1b7b50db5927b96f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927b968 expref: 12 pid: 5826 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.172636:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521661.172664:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+11:3304:x1875400816858624:12345-0@lo:103: Request processed in 66us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521661.172670:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788521661.172709:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816858624:0@lo:103: 00000100:00100000:3.0:1788521661.172735:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816858496:0@lo:103: 00010000:00010000:0.0:1788521661.173736:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1788521661.173747:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85748700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+4:5826:x1875400816858240:12345-0@lo:104: Request processed in 10073us (10853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521661.173756:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521661.173817:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521661.173965:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85748380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+3:5826:x1875400816858368:12345-0@lo:104: 00010000:00010000:0.0:1788521661.173978:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927b94c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927b953 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521661.174189:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85749f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1875400816858368:0@lo:104: 00010000:00010000:3.0:1788521661.174223:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996f8392d800/0x1b7b50db5927ba3a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521661.175181:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521661.175191:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927b94c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927b953 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521661.175199:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80031800 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:2.0:1788521661.175367:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927b94c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927b953 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521661.175376:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927b94c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927b953 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521661.175383:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927b94c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927b953 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521661.175388:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521661.178022:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1788521661.178039:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85748380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+3:5826:x1875400816858368:12345-0@lo:104: Request processed in 4073us (15058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521661.178139:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788521661.180204:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927b94c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927b953 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521661.180219:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788521661.180327:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927b94c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927b953 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521661.180494:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3305:1875400816858752:0@lo:103: 00000100:00100000:0.0:1788521661.180552:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521661.180609:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816858752 00010000:00010000:1.0:1788521661.180693:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927b94c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927b953 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521661.180777:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521661.180779:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521661.180781:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521661.180817:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816858752 00010000:00010000:0.0:1788521661.180977:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996f829d4e00/0x1b7b50db5927b953 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927b94c expref: 11 pid: 5826 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521661.181189:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521661.181199:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+11:3305:x1875400816858752:12345-0@lo:103: 00010000:00010000:0.0:1788521661.181241:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521661.181247:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996f829d4e00/0x1b7b50db5927b953 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927b94c expref: 11 pid: 5826 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521661.181264:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996f829d4e00/0x1b7b50db5927b953 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927b94c expref: 11 pid: 5826 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521661.181278:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f829d4e00/0x1b7b50db5927b953 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927b94c expref: 11 pid: 5826 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521661.181293:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996f8392d800/0x1b7b50db5927ba3a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521661.181307:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8392d800/0x1b7b50db5927ba3a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521661.181330:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996f8392d800/0x1b7b50db5927ba3a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521661.181338:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996f8392d800/0x1b7b50db5927ba3a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521661.181339:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521661.181355:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996f8392d800/0x1b7b50db5927ba3a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521661.181362:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996f8392d800/0x1b7b50db5927ba3a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521661.181368:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392d800 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521661.181373:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996f8392d800/0x1b7b50db5927ba3a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521661.181380:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996f8392d800/0x1b7b50db5927ba3a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521661.181401:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996f8392d800/0x1b7b50db5927ba3a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521661.181417:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521661.181458:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+10:3305:x1875400816858752:12345-0@lo:103: Request processed in 261us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521661.181465:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788521661.181476:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3305:1875400816858752:0@lo:103: 00010000:00010000:2.0:1788521661.181511:0:5826:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996f8392d800/0x1b7b50db5927ba3a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521661.181520:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996f8392d800/0x1b7b50db5927ba3a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521661.181526:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8392d800/0x1b7b50db5927ba3a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788521661.181537:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788521661.245192:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+9:6685:x1875400816857984:12345-0@lo:253: Request processed in 102553us (105510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521661.245217:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788521661.245753:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816857984:0@lo:253: 10000000:01000000:3.0:1788521661.245770:0:6685:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788521661.245773:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788521661.245775:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788521661.245789:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788521661.245791:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788521661.245792:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788521661.245793:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788521661.245795:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788521661.245796:0:6685:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788521661.245798:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788521661.245799:0:6685:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788521661.245818:0:6685:0:(tgt_mount.c:101:server_register_mount()) register mount ffff996f97fff000 from lustre-OST0000 10000000:01000000:3.0:1788521661.245841:0:6685:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788521661.245844:0:6685:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788521661.245850:0:6685:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff996f8606b380 local copy 10000000:01000000:3.0:1788521661.245853:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788521661.245886:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392d600/0x1b7b50db5927ba41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.245897:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.148@tcp lock: ffff996f8392d600/0x1b7b50db5927ba41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.245906:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f8392d600/0x1b7b50db5927ba41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521661.245924:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85749f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816858880:0@lo:101: 00000100:00100000:3.0:1788521661.245961:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521661.246016:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f82df43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521661.246076:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816858880 00000100:00100000:0.0:1788521661.246089:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816858880 00000100:00100000:0.0:1788521661.246126:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788521661.246133:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+9:6685:x1875400816858880:12345-0@lo:101: 00010000:00010000:0.0:1788521661.246165:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521661.246178:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f80031800/0x1b7b50db5927ba48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927ba41 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521661.246198:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f80031800/0x1b7b50db5927ba48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927ba41 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521661.246275:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f80031800/0x1b7b50db5927ba48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927ba41 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521661.246285:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f80031800, rc 0) 00000100:00100000:0.0:1788521661.246332:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+10:6685:x1875400816858880:12345-0@lo:101: Request processed in 199us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521661.246338:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788521661.246551:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85749f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816858880:0@lo:101: 00010000:00010000:3.0:1788521661.246564:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f8392d600/0x1b7b50db5927ba41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1b7b50db5927ba48 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.246574:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f8392d600/0x1b7b50db5927ba41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1b7b50db5927ba48 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521661.246673:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85749f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816859008:0@lo:501: 00000100:00100000:3.0:1788521661.246704:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521661.246726:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f82df43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521661.246781:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816859008 00000100:00100000:0.0:1788521661.246785:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816859008 00000100:00100000:0.0:1788521661.246802:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788521661.246808:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+10:6685:x1875400816859008:12345-0@lo:501: 00000100:00100000:0.0:1788521661.246994:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+10:6685:x1875400816859008:12345-0@lo:501: Request processed in 185us (288us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788521661.247000:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788521661.247166:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85749f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816859008:0@lo:501: 10000000:01000000:3.0:1788521661.247179:0:6685:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788521661.247298:0:6685:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788521661.247304:0:6685:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392d600/0x1b7b50db5927ba41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1b7b50db5927ba48 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.247312:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392d600/0x1b7b50db5927ba41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1b7b50db5927ba48 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.247327:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff996f8392d600/0x1b7b50db5927ba41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1b7b50db5927ba48 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.247542:0:6685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788521661.247563:0:6685:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff996f97fff000 10000000:01000000:3.0:1788521661.247568:0:6685:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788521661.247572:0:6685:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff996f8606b380 10000000:01000000:3.0:1788521661.247574:0:6685:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788521661.247577:0:6685:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff996f8606b380 from 1 10000000:01000000:3.0:1788521661.247579:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788521661.247599:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392ca00/0x1b7b50db5927ba4f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.247607:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996f8392ca00/0x1b7b50db5927ba4f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.247614:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f8392ca00/0x1b7b50db5927ba4f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521661.247638:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85749f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816859136:0@lo:101: 00000100:00100000:3.0:1788521661.247667:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521661.247697:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f82df4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521661.249970:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816859136 00000100:00100000:0.0:1788521661.249982:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816859136 00000100:00100000:0.0:1788521661.250042:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788521661.250052:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+10:6685:x1875400816859136:12345-0@lo:101: 00010000:00010000:0.0:1788521661.250067:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521661.250094:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f80030200/0x1b7b50db5927ba56 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927ba4f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521661.250119:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f80030200/0x1b7b50db5927ba56 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927ba4f expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521661.250130:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f80030200/0x1b7b50db5927ba56 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927ba4f expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521661.250138:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f80030200, rc 0) 00000100:00100000:0.0:1788521661.250231:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+11:6685:x1875400816859136:12345-0@lo:101: Request processed in 181us (2562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521661.250237:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788521661.250336:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85749f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816859136:0@lo:101: 00010000:00010000:3.0:1788521661.250362:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f8392ca00/0x1b7b50db5927ba4f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927ba56 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.250372:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f8392ca00/0x1b7b50db5927ba4f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927ba56 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521661.250401:0:6685:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788521661.250420:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392ca00/0x1b7b50db5927ba4f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927ba56 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.250428:0:6685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996f8392ca00/0x1b7b50db5927ba4f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927ba56 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521661.250436:0:6685:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788521661.250440:0:6685:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788521661.250446:0:6685:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788521661.250448:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788521661.250469:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392da00/0x1b7b50db5927ba5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.250477:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996f8392da00/0x1b7b50db5927ba5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.250484:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f8392da00/0x1b7b50db5927ba5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521661.250505:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85749f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816859264:0@lo:101: 00000100:00100000:3.0:1788521661.250533:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521661.250557:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f82df4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521661.253533:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816859264 00000100:00100000:2.0:1788521661.253547:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816859264 00000100:00100000:2.0:1788521661.253614:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788521661.253625:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+11:6685:x1875400816859264:12345-0@lo:101: 00010000:00010000:2.0:1788521661.253640:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521661.253656:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f8149c600/0x1b7b50db5927ba64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927ba5d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521661.253698:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8149c600/0x1b7b50db5927ba64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927ba5d expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521661.253709:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f8149c600/0x1b7b50db5927ba64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927ba5d expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521661.253718:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8149c600, rc 0) 00000100:00100000:2.0:1788521661.253785:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:6685:x1875400816859264:12345-0@lo:101: Request processed in 163us (3251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521661.253792:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788521661.254274:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85749f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816859264:0@lo:101: 00010000:00010000:3.0:1788521661.254293:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f8392da00/0x1b7b50db5927ba5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927ba64 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.254303:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f8392da00/0x1b7b50db5927ba5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927ba64 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521661.254575:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85749f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816859392:0@lo:501: 00000100:00100000:3.0:1788521661.254610:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521661.254647:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f82df4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521661.254705:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816859392 00000100:00100000:0.0:1788521661.254710:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816859392 00000100:00100000:0.0:1788521661.254745:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788521661.254752:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:6685:x1875400816859392:12345-0@lo:501: 00000100:00100000:0.0:1788521661.254960:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:6685:x1875400816859392:12345-0@lo:501: Request processed in 207us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521661.254967:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788521661.255193:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85749f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816859392:0@lo:501: 00000100:00100000:3.0:1788521661.255223:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85749f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816859520:0@lo:503: 00000100:00100000:3.0:1788521661.255263:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521661.255281:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f82df4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521661.255352:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816859520 00000100:00100000:0.0:1788521661.255357:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816859520 00000100:00100000:0.0:1788521661.255387:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788521661.255601:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:6685:x1875400816859520:12345-0@lo:503: 00000100:00100000:0.0:1788521661.255747:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:6685:x1875400816859520:12345-0@lo:503: Request processed in 353us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521661.255753:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788521661.257511:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85749f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816859520:0@lo:503: 00000040:00080000:3.0:1788521661.257807:0:6685:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788521661.257883:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85749f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816859648:0@lo:502: 00000100:00100000:3.0:1788521661.257946:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521661.258040:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f82df4a80 going to sleep for 11 seconds 00010000:00010000:1.0:1788521661.258591:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521661.258600:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f8392d600/0x1b7b50db5927ba41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1b7b50db5927ba48 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521661.258610:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392d600 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:1.0:1788521661.258614:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f8392d600/0x1b7b50db5927ba41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1b7b50db5927ba48 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521661.258623:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f8392d600/0x1b7b50db5927ba41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x1b7b50db5927ba48 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521661.258631:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f8392d600/0x1b7b50db5927ba41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x1b7b50db5927ba48 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521661.258636:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788521661.258659:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f8392d600/0x1b7b50db5927ba41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1b7b50db5927ba48 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521661.258666:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788521661.258687:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f8392d600/0x1b7b50db5927ba41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1b7b50db5927ba48 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521661.258695:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f8392d600/0x1b7b50db5927ba41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1b7b50db5927ba48 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521661.258717:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521661.258719:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521661.258721:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521661.259107:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816859648 00000100:00100000:2.0:1788521661.259116:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816859648 00000100:00100000:3.0:1788521661.259253:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788521661.259270:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816859776:0@lo:103: 00000100:00100000:3.0:1788521661.259330:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521661.270602:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816859776 00000100:00100000:1.0:1788521661.270622:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816859776 00000100:00100000:3.0:1788521661.273900:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788521661.273916:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f8574a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:3307:x1875400816859776:12345-0@lo:103: 00010000:00010000:3.0:1788521661.273933:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521661.273952:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f80031800/0x1b7b50db5927ba48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b7b50db5927ba41 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.273970:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521661.274048:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f8574a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:3307:x1875400816859776:12345-0@lo:103: Request processed in 136us (14717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521661.274055:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788521661.274109:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788521661.274119:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+11:6685:x1875400816859648:12345-0@lo:502: 00000100:00100000:2.0:1788521661.274126:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816859776:0@lo:103: 00000100:00100000:0.0:1788521661.274678:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+11:6685:x1875400816859648:12345-0@lo:502: Request processed in 560us (16731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521661.274686:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788521661.276332:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85749f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816859648:0@lo:502: 00000040:00080000:2.0:1788521661.276666:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788521661.276720:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788521661.276748:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788521661.276788:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788521661.276833:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788521661.276863:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788521661.276896:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816859904:0@lo:502: 00000100:00100000:2.0:1788521661.276952:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521661.277004:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb18fa840 going to sleep for 11 seconds 00000100:00100000:0.0:1788521661.277679:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816859904 00000100:00100000:0.0:1788521661.277687:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816859904 00000100:00100000:0.0:1788521661.277749:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788521661.277758:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+11:6685:x1875400816859904:12345-0@lo:502: 00000100:00100000:0.0:1788521661.277946:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+11:6685:x1875400816859904:12345-0@lo:502: Request processed in 189us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521661.277953:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788521661.278073:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816859904:0@lo:502: 00000040:00080000:3.0:1788521661.278201:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788521661.279547:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1788521661.284361:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788521661.284374:0:6704:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788521661.284381:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521661.284383:0:6704:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788521661.284389:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788521661.284404:0:6704:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff996fb47db380) 00000020:00000080:0.0:1788521661.284448:0:6704:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788521661.284455:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788521661.284513:0:6704:0:(tgt_mount.c:153:server_get_mount()) get mount ffff996f97fff000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788521661.284520:0:6704:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788521661.284526:0:6704:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1b7b50db5927ba72 00010000:00010000:0.0:1788521661.291570:0:6704:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1788521661.291854:0:6704:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1788521661.297079:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788521661.297376:0:6704:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788521661.309613:0:6704:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788521661.311810:0:6704:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788521661.319576:0:6704:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788521661.319590:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521661.319597:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521661.319599:0:6704:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788521661.319609:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521661.319613:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521661.319614:0:6704:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788521661.319617:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788521661.319619:0:6704:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788521661.319668:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521661.319672:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521661.319674:0:6704:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788521661.319676:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788521661.319850:0:6685:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788521661.319874:0:6685:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788521661.319894:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392da00/0x1b7b50db5927ba5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927ba64 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.319913:0:6685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996f8392da00/0x1b7b50db5927ba5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927ba64 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521661.319921:0:6685:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff996f97fff000 from 1 10000000:01000000:3.0:1788521661.319923:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788521661.319955:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392c000/0x1b7b50db5927ba79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.319962:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996f8392c000/0x1b7b50db5927ba79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.319977:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f8392c000/0x1b7b50db5927ba79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521661.319998:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f8574b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816860032:0@lo:101: 00000100:00100000:3.0:1788521661.320057:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521661.320114:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f82df49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521661.320175:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816860032 00000100:00100000:2.0:1788521661.320182:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816860032 00000100:00100000:2.0:1788521661.320227:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788521661.320236:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+11:6685:x1875400816860032:12345-0@lo:101: 00010000:00010000:2.0:1788521661.320249:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521661.320261:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f8149cc00/0x1b7b50db5927ba80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927ba79 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521661.320283:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8149cc00/0x1b7b50db5927ba80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927ba79 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521661.320293:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f8149cc00/0x1b7b50db5927ba80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927ba79 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521661.320301:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8149cc00, rc 0) 00000100:00100000:2.0:1788521661.320459:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:6685:x1875400816860032:12345-0@lo:101: Request processed in 224us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521661.320466:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788521661.320602:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f8574b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816860032:0@lo:101: 00010000:00010000:3.0:1788521661.320617:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f8392c000/0x1b7b50db5927ba79 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927ba80 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521661.320627:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f8392c000/0x1b7b50db5927ba79 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927ba80 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521661.320712:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f8574b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816860160:0@lo:501: 00000100:00100000:3.0:1788521661.320736:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521661.320767:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f82df49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521661.322385:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816860160 00000100:00100000:2.0:1788521661.322396:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816860160 00000100:00100000:2.0:1788521661.322443:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788521661.322451:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:6685:x1875400816860160:12345-0@lo:501: 00000100:00100000:2.0:1788521661.322700:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:6685:x1875400816860160:12345-0@lo:501: Request processed in 250us (1962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521661.322707:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788521661.330098:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f8574b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816860160:0@lo:501: 00000100:00100000:3.0:1788521661.330201:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f8574b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816860288:0@lo:503: 00000100:00100000:3.0:1788521661.330299:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521661.330347:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f82df49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521661.330564:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816860288 00000100:00100000:2.0:1788521661.330571:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816860288 00000100:00100000:2.0:1788521661.330614:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788521661.330623:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:6685:x1875400816860288:12345-0@lo:503: 00000100:00100000:2.0:1788521661.330875:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:6685:x1875400816860288:12345-0@lo:503: Request processed in 252us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521661.330883:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788521661.332789:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f8574b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816860288:0@lo:503: 00000040:00080000:1.0:1788521661.335714:0:6685:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788521661.335803:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816860416:0@lo:502: 00000100:00100000:1.0:1788521661.336511:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521661.336604:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f85316900 going to sleep for 11 seconds 00000100:00100000:2.0:1788521661.352616:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816860416 00000100:00100000:2.0:1788521661.352630:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816860416 00000100:00100000:2.0:1788521661.352699:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788521661.352709:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:6685:x1875400816860416:12345-0@lo:502: 00000100:00100000:2.0:1788521661.353847:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:6685:x1875400816860416:12345-0@lo:502: Request processed in 1136us (17333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521661.353858:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788521661.354051:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816860416:0@lo:502: 00000040:00080000:1.0:1788521661.354380:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788521661.354447:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788521661.354481:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816860544:0@lo:502: 00000100:00100000:1.0:1788521661.354523:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521661.354573:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb54e5600 going to sleep for 11 seconds 00000100:00100000:3.0:1788521661.354686:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816860544 00000100:00100000:3.0:1788521661.354692:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816860544 00000100:00100000:3.0:1788521661.354734:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788521661.354742:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:6685:x1875400816860544:12345-0@lo:502: 00000100:00100000:3.0:1788521661.355031:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:6685:x1875400816860544:12345-0@lo:502: Request processed in 288us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521661.355045:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788521661.355091:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816860544:0@lo:502: 00000040:00080000:2.0:1788521661.355751:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788521661.355766:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788521661.363186:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521661.363200:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521661.363202:0:6708:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788521661.363209:0:6708:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff996f97fff000 00000020:00000080:2.0:1788521661.363211:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788521661.363230:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521661.363232:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521661.363234:0:6708:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788521661.363247:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788521661.363334:0:6685:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788521661.363358:0:6685:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788521661.363379:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392c000/0x1b7b50db5927ba79 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927ba80 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521661.363390:0:6685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996f8392c000/0x1b7b50db5927ba79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927ba80 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521661.363440:0:6685:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788521661.363442:0:6685:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff996f97fff000 10000000:01000000:1.0:1788521661.363445:0:6685:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff996f97fff000 10000000:01000000:1.0:1788521661.363457:0:6685:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788521661.363462:0:6685:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff996f97fff000 from 1 10000000:01000000:1.0:1788521661.363465:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788521661.363496:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927ba87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521661.363504:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927ba87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521661.363515:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927ba87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521661.363538:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98070e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816860672:0@lo:101: 00000100:00100000:1.0:1788521661.363597:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521661.363640:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb54e5480 going to sleep for 11 seconds 00000100:00100000:2.0:1788521661.365497:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816860672 00000100:00100000:2.0:1788521661.365509:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816860672 00000100:00100000:2.0:1788521661.365566:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788521661.365576:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:6685:x1875400816860672:12345-0@lo:101: 00010000:00010000:2.0:1788521661.365591:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521661.365603:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f8149d600/0x1b7b50db5927ba8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927ba87 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521661.365627:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8149d600/0x1b7b50db5927ba8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927ba87 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521661.365637:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f8149d600/0x1b7b50db5927ba8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927ba87 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521661.365645:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8149d600, rc 0) 00000100:00100000:2.0:1788521661.365704:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:6685:x1875400816860672:12345-0@lo:101: Request processed in 130us (2106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521661.365710:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788521661.366023:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98070e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816860672:0@lo:101: 00010000:00010000:1.0:1788521661.366040:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927ba87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927ba8e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521661.366050:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927ba87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927ba8e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521661.366186:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98070e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816860800:0@lo:501: 00000100:00100000:1.0:1788521661.366224:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521661.366254:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb54e5480 going to sleep for 11 seconds 00000100:00100000:2.0:1788521661.366528:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816860800 00000100:00100000:2.0:1788521661.366533:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816860800 00000100:00100000:2.0:1788521661.366571:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788521661.366579:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:6685:x1875400816860800:12345-0@lo:501: 00000100:00100000:2.0:1788521661.366783:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:6685:x1875400816860800:12345-0@lo:501: Request processed in 204us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521661.366789:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788521661.367013:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98070e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816860800:0@lo:501: 00000100:00100000:3.0:1788521661.367046:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f8574b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816860928:0@lo:503: 00000100:00100000:3.0:1788521661.367086:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521661.367117:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f82df43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521661.367282:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816860928 00000100:00100000:2.0:1788521661.367287:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816860928 00000100:00100000:2.0:1788521661.367328:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788521661.367342:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:6685:x1875400816860928:12345-0@lo:503: 00000100:00100000:2.0:1788521661.367500:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:6685:x1875400816860928:12345-0@lo:503: Request processed in 159us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521661.367506:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788521661.367866:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f8574b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816860928:0@lo:503: 00000040:00080000:3.0:1788521661.368197:0:6685:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788521661.368261:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f8574b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816861056:0@lo:502: 00000100:00100000:3.0:1788521661.368302:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521661.368332:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816861056 00000100:00100000:1.0:1788521661.368337:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816861056 00000100:00100000:3.0:1788521661.368338:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f82df43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521661.368379:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788521661.368387:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:6685:x1875400816861056:12345-0@lo:502: 00000100:00100000:1.0:1788521661.368666:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:6685:x1875400816861056:12345-0@lo:502: Request processed in 280us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521661.368673:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788521661.368695:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f8574b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816861056:0@lo:502: 00000040:00080000:3.0:1788521661.369064:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788521661.369109:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788521661.369162:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788521661.369472:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788521661.369513:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788521661.369559:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788521661.369602:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788521661.369628:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788521661.369664:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788521661.369691:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788521661.369716:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788521661.369750:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788521661.369776:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788521661.369801:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788521661.369858:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788521661.369890:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788521661.371037:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788521661.371098:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788521661.371128:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788521661.371177:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788521661.371591:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788521661.371630:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788521661.371658:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788521661.371698:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788521661.371729:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788521661.371762:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788521661.371806:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788521661.371842:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1788521661.371900:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816861184:0@lo:502: 00000100:00100000:2.0:1788521661.371968:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521661.372025:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816861184 00000100:00100000:3.0:1788521661.372032:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816861184 00000100:00100000:3.0:1788521661.372082:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788521661.372092:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:6685:x1875400816861184:12345-0@lo:502: 00000100:00100000:2.0:1788521661.372622:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb18fa300 going to sleep for 11 seconds 00000100:00100000:3.0:1788521661.372640:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:6685:x1875400816861184:12345-0@lo:502: Request processed in 549us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521661.372644:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816861184:0@lo:502: 00000100:00100000:3.0:1788521661.372647:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000040:00080000:2.0:1788521661.372719:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788521661.372730:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788521661.374125:0:6709:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788521661.374139:0:6709:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff996fae060000) 00000020:00000080:3.0:1788521661.374175:0:6709:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1788521661.375121:0:6709:0:(tgt_mount.c:153:server_get_mount()) get mount ffff996f97fff000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788521661.375127:0:6709:0:(tgt_mount.c:187:server_put_mount()) put mount ffff996f97fff000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788521661.375130:0:6709:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996f97fff000 3 00010000:00080000:2.0:1788521661.375211:0:6709:0:(ldlm_lib.c:102:import_set_conn()) imp ffff996f85cd6000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.148@tcp at head 00010000:00010000:3.0:1788521661.386194:0:6709:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1788521661.386425:0:6709:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788521661.386464:0:6709:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788521661.386475:0:6709:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x1b7b50db5927ba9c 00000100:00080000:3.0:1788521661.386485:0:6709:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788521661.386492:0:6709:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff996f85cd6000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1788521661.386526:0:6709:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996f8574b800 x1875400816861312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788521661.386553:0:6709:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788521661.386846:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f8574b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875400816861312:0@lo:38: 00000100:00100000:2.0:1788521661.386911:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521661.386979:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816861312 00000100:00100000:2.0:1788521661.386985:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816861312 00000100:00100000:2.0:1788521661.387025:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788521661.387032:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3303:x1875400816861312:12345-0@lo:38: 00010000:00080000:2.0:1788521661.387060:0:5834:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 161 last 0 00000020:00000080:2.0:1788521661.387090:0:5834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1b7b50db5927baa3 00000004:00100000:2.0:1788521661.387103:0:5834:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788521661.387131:0:5834:0:(import.c:65:import_set_state_nolock()) ffff996fae01d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788521661.387192:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875400816861312:12345-0@lo:38: Request processed in 158us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521661.387200:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788521661.387230:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff996f8574b800 x1875400816861312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788521671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521661.387240:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788521661.387247:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788521661.387253:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788521661.387256:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788521661.387259:0:3303:0:(import.c:65:import_set_state_nolock()) ffff996f85cd6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788521661.387264:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f8574b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875400816861312:0@lo:38: 00000100:00100000:0.0:1788521661.388574:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521661.388588:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875400816861440:0@lo:400: 00000100:00100000:0.0:1788521661.388633:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788521661.388806:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:2.0:1788521661.394219:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816861440 00000100:00100000:2.0:1788521661.394234:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816861440 00000100:00100000:2.0:1788521661.394290:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788521661.394301:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875400816861440:12345-0@lo:400: 00000100:00100000:2.0:1788521661.394393:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875400816861440:12345-0@lo:400: Request processed in 94us (5758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521661.394412:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788521661.394776:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff996fb3f5b480 x1875400816861440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521661.394793:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875400816861440:0@lo:400: 00000020:01000000:2.0:1788521661.395199:0:6685:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788521661.395468:0:6685:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788521661.395484:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927ba87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927ba8e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521661.395517:0:6685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927ba87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927ba8e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788521661.395560:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788521661.395562:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788521661.395563:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521661.395564:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521661.395565:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521661.395566:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521661.395568:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788521661.395569:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788521661.395570:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788521661.395572:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521661.395573:0:6685:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788521661.395576:0:6685:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788521661.395578:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788521661.395579:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788521661.395580:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521661.395581:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521661.395582:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521661.395583:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521661.395585:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788521661.395586:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788521661.395586:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788521661.395587:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521661.395588:0:6685:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788521661.395609:0:6685:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788521661.395622:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816861568:0@lo:253: 00000100:00100000:2.0:1788521661.395671:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521661.395834:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb18fa0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521661.395985:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816861568 00000100:00100000:3.0:1788521661.395991:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816861568 00000100:00100000:3.0:1788521661.396138:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788521661.396167:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:6685:x1875400816861568:12345-0@lo:253: 20000000:01000000:3.0:1788521661.396190:0:5826:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788521661.396220:0:5826:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788521661.433662:0:5826:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788521661.433678:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788521661.433766:0:5849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788521661.433770:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788521661.433790:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996f80030c00/0x1b7b50db5927baaa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521661.433808:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996f8149c800/0x1b7b50db5927ba02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927b9fb expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521661.433817:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996f80030c00/0x1b7b50db5927baaa lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521661.433867:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996f8149c800/0x1b7b50db5927ba02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927b9fb expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521661.433885:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996f8149c800/0x1b7b50db5927ba02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927b9fb expref: 13 pid: 5828 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521661.433899:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f5b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1875400816861696:0@lo:104: 00000100:00100000:0.0:1788521661.433954:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521661.434106:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f85c9d840 going to sleep for 11 seconds 00000100:00100000:1.0:1788521661.435388:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816861696 00000100:00100000:1.0:1788521661.435407:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816861696 00000100:00100000:1.0:1788521661.435455:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788521661.435467:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+3:5849:x1875400816861696:12345-0@lo:104: 00010000:00010000:1.0:1788521661.435483:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996f80030000/0x1b7b50db5927b9fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927ba02 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521661.435561:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788521661.435567:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+3:5849:x1875400816861696:12345-0@lo:104: Request processed in 105us (1613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521661.435574:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788521661.435595:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521661.435600:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f80030000/0x1b7b50db5927b9fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927ba02 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521661.435607:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80030000 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:1.0:1788521661.435611:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f80030000/0x1b7b50db5927b9fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927ba02 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521661.435619:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f80030000/0x1b7b50db5927b9fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927ba02 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521661.435625:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f80030000/0x1b7b50db5927b9fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927ba02 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521661.435631:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788521661.435685:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f80030000/0x1b7b50db5927b9fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927ba02 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521661.435692:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788521661.435723:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f80030000/0x1b7b50db5927b9fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927ba02 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521661.435730:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f80030000/0x1b7b50db5927b9fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927ba02 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521661.435745:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521661.435747:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521661.435748:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521661.435770:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816861824:0@lo:103: 00000100:00100000:1.0:1788521661.435805:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521661.435870:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816861824 00000100:00100000:1.0:1788521661.435875:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816861824 00010000:00010000:1.0:1788521661.435892:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996f8149c800/0x1b7b50db5927ba02 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927b9fb expref: 14 pid: 5828 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521661.435911:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788521661.435917:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f9130b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:3304:x1875400816861824:12345-0@lo:103: 00010000:00010000:1.0:1788521661.435926:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521661.435931:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996f8149c800/0x1b7b50db5927ba02 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927b9fb expref: 14 pid: 5828 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521661.435945:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996f8149c800/0x1b7b50db5927ba02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927b9fb expref: 14 pid: 5828 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521661.435962:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996f80030c00/0x1b7b50db5927baaa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521661.435976:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f80030c00/0x1b7b50db5927baaa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788521661.435991:0:5819:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002220051s 00010000:00010000:1.0:1788521661.436467:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996f80030c00/0x1b7b50db5927baaa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521661.436476:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996f80030c00/0x1b7b50db5927baaa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521661.436483:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996f80030c00/0x1b7b50db5927baaa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521661.436489:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996f80030c00/0x1b7b50db5927baaa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521661.436494:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80030c00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:1.0:1788521661.436498:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996f80030c00/0x1b7b50db5927baaa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521661.436505:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996f80030c00/0x1b7b50db5927baaa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521661.436513:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996f80030c00/0x1b7b50db5927baaa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521661.436523:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521661.436572:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f9130b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:3304:x1875400816861824:12345-0@lo:103: Request processed in 654us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521661.436580:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788521661.436653:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8149c800/0x1b7b50db5927ba02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927b9fb expref: 13 pid: 5828 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521661.436665:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f5b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1875400816861696:0@lo:104: 00010000:00010000:1.0:1788521661.436680:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996f80030c00/0x1b7b50db5927baaa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521661.436688:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996f80030c00/0x1b7b50db5927baaa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521661.436693:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996f80030c00/0x1b7b50db5927baaa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521661.436782:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816861824:0@lo:103: 00010000:00010000:1.0:1788521661.436826:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f80030c00/0x1b7b50db5927baaa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521661.455498:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:6685:x1875400816861568:12345-0@lo:253: Request processed in 59325us (59818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521661.455512:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788521661.455597:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6685:1875400816861568:0@lo:253: 10000000:01000000:1.0:1788521661.455613:0:6685:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788521661.455616:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788521661.455618:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788521661.455619:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788521661.455621:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788521661.455622:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788521661.455623:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788521661.455625:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788521661.455626:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788521661.455628:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788521661.455629:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788521661.455630:0:6685:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788521661.455645:0:6685:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788521661.464855:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788521661.465326:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788521661.465618:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788521661.465872:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788521661.466573:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788521661.467788:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788521661.481853:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1788521661.584495:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788521661.816685:0:6685:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788521661.816694:0:6685:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788521661.816731:0:6685:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788521661.816811:0:6685:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.148@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788521661.816829:0:6685:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788521661.816857:0:6685:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 10000000:01000000:1.0:1788521662.351472:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788521662.351492:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff996f85616000 from 21 10000000:01000000:1.0:1788521662.351498:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788521662.351548:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f829d4200/0x1b7b50db5927bab1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521662.351560:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996f829d4200/0x1b7b50db5927bab1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521662.351571:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f829d4200/0x1b7b50db5927bab1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521662.351594:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98070700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816861952:0@lo:101: 00000100:00100000:1.0:1788521662.351921:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521662.352032:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb18d7600 going to sleep for 11 seconds 00000100:00100000:3.0:1788521662.372272:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816861952 00000100:00100000:3.0:1788521662.372299:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816861952 00000100:00100000:3.0:1788521662.372375:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788521662.372385:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:5830:x1875400816861952:12345-0@lo:101: 00010000:00010000:3.0:1788521662.372401:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521662.372419:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f8392d000/0x1b7b50db5927bab8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927bab1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521662.372446:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8392d000/0x1b7b50db5927bab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927bab1 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521662.372458:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f8392d000/0x1b7b50db5927bab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bab1 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521662.372467:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392d000, rc 0) 00000100:00100000:3.0:1788521662.372785:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:5830:x1875400816861952:12345-0@lo:101: Request processed in 401us (20864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521662.372792:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788521662.372978:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98070700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816861952:0@lo:101: 00010000:00010000:0.0:1788521662.372998:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f829d4200/0x1b7b50db5927bab1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bab8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521662.373008:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f829d4200/0x1b7b50db5927bab1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bab8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521662.373094:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f58e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816862080:0@lo:501: 00000100:00100000:0.0:1788521662.373130:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521662.373210:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fbc3c4300 going to sleep for 11 seconds 00000100:00100000:3.0:1788521662.376642:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816862080 00000100:00100000:3.0:1788521662.376655:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816862080 00000100:00100000:3.0:1788521662.376711:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788521662.376720:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:5830:x1875400816862080:12345-0@lo:501: 00000100:00100000:3.0:1788521662.377248:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:5830:x1875400816862080:12345-0@lo:501: Request processed in 527us (4116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521662.377257:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788521662.377997:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f58e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816862080:0@lo:501: 00000100:00100000:3.0:1788521662.378059:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85749880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816862208:0@lo:503: 00000100:00100000:3.0:1788521662.378107:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521662.378168:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86745240 going to sleep for 11 seconds 00000100:00100000:2.0:1788521662.378981:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816862208 00000100:00100000:2.0:1788521662.378995:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816862208 00000100:00100000:2.0:1788521662.379265:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788521662.379275:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:5830:x1875400816862208:12345-0@lo:503: 00000100:00100000:2.0:1788521662.379647:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:5830:x1875400816862208:12345-0@lo:503: Request processed in 373us (1538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521662.379654:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788521662.380078:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85749880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816862208:0@lo:503: 00000100:00100000:3.0:1788521662.380850:0:6732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85749880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6732:1875400816862336:0@lo:502: 00000100:00100000:3.0:1788521662.380905:0:6732:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521662.380945:0:6732:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86745300 going to sleep for 11 seconds 00000100:00100000:0.0:1788521662.381049:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816862336 00000100:00100000:0.0:1788521662.381056:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816862336 00000100:00100000:0.0:1788521662.381097:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788521662.381105:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:6732:x1875400816862336:12345-0@lo:502: 00000100:00100000:0.0:1788521662.381406:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:6732:x1875400816862336:12345-0@lo:502: Request processed in 301us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521662.381414:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788521662.381616:0:6732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85749880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6732:1875400816862336:0@lo:502: 00000100:00100000:1.0:1788521662.381683:0:6732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6732:1875400816862464:0@lo:502: 00000100:00100000:1.0:1788521662.381720:0:6732:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521662.381749:0:6732:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb18d7480 going to sleep for 11 seconds 00000100:00100000:0.0:1788521662.381940:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816862464 00000100:00100000:0.0:1788521662.381944:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816862464 00000100:00100000:0.0:1788521662.381979:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788521662.381987:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:6732:x1875400816862464:12345-0@lo:502: 00000100:00100000:0.0:1788521662.382121:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:6732:x1875400816862464:12345-0@lo:502: Request processed in 135us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521662.382128:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788521662.384112:0:6732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6732:1875400816862464:0@lo:502: 00000040:00080000:1.0:1788521662.384169:0:6732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1788521662.384226:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788521662.384248:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788521662.384260:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f829d4200/0x1b7b50db5927bab1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bab8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521662.384271:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996f829d4200/0x1b7b50db5927bab1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bab8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521662.384280:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788521662.384303:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff996f85616000 from 4 10000000:01000000:1.0:1788521662.384306:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788521662.385906:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f829d4400/0x1b7b50db5927babf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521662.385920:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996f829d4400/0x1b7b50db5927babf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521662.385932:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f829d4400/0x1b7b50db5927babf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521662.385953:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816862592:0@lo:101: 00000100:00100000:1.0:1788521662.386010:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521662.386050:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb18d7480 going to sleep for 11 seconds 00000100:00100000:0.0:1788521662.387772:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816862592 00000100:00100000:0.0:1788521662.387784:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816862592 00000100:00100000:0.0:1788521662.387857:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788521662.387869:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:5830:x1875400816862592:12345-0@lo:101: 00010000:00010000:0.0:1788521662.387884:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521662.387901:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f80030400/0x1b7b50db5927bac6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927babf expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521662.387927:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f80030400/0x1b7b50db5927bac6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927babf expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521662.387937:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f80030400/0x1b7b50db5927bac6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927babf expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521662.387946:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f80030400, rc 0) 00000100:00100000:0.0:1788521662.388003:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:5830:x1875400816862592:12345-0@lo:101: Request processed in 137us (1993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521662.388009:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788521662.388016:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816862592:0@lo:101: 00010000:00010000:2.0:1788521662.388106:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f829d4400/0x1b7b50db5927babf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bac6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521662.388115:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f829d4400/0x1b7b50db5927babf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bac6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521662.388254:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816862720:0@lo:256: 00000100:00100000:2.0:1788521662.388286:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521662.388321:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86759cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521662.388642:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816862720 00000100:00100000:3.0:1788521662.388648:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816862720 00000100:00100000:3.0:1788521662.388682:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788521662.388690:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:5830:x1875400816862720:12345-0@lo:256: 20000000:01000000:3.0:1788521662.388704:0:5827:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788521662.388719:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788521662.388722:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788521662.388798:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:5830:x1875400816862720:12345-0@lo:256: Request processed in 108us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521662.388805:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788521662.388848:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816862720:0@lo:256: 10000000:01000000:3.0:1788521662.388889:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788521662.388896:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f829d4400/0x1b7b50db5927babf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bac6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521662.388904:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996f829d4400/0x1b7b50db5927babf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bac6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521662.388912:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788521662.388919:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788521662.388922:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788521662.388942:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392ce00/0x1b7b50db5927bacd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521662.388948:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996f8392ce00/0x1b7b50db5927bacd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521662.388956:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f8392ce00/0x1b7b50db5927bacd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521662.388968:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f8574aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816862848:0@lo:101: 00000100:00100000:3.0:1788521662.388991:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521662.389010:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86745840 going to sleep for 11 seconds 00000100:00100000:0.0:1788521662.389237:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816862848 00000100:00100000:0.0:1788521662.389242:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816862848 00000100:00100000:0.0:1788521662.389265:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788521662.389271:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:5830:x1875400816862848:12345-0@lo:101: 00010000:00010000:0.0:1788521662.389279:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521662.389287:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f80031400/0x1b7b50db5927bad4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927bacd expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521662.389326:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f80031400/0x1b7b50db5927bad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927bacd expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521662.389335:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f80031400/0x1b7b50db5927bad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bacd expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521662.389343:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f80031400, rc 0) 00000100:00100000:0.0:1788521662.389375:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:5830:x1875400816862848:12345-0@lo:101: Request processed in 103us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521662.389381:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788521662.389411:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f8574aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816862848:0@lo:101: 00010000:00010000:0.0:1788521662.389423:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f8392ce00/0x1b7b50db5927bacd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bad4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521662.389430:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f8392ce00/0x1b7b50db5927bacd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bad4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521662.389473:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816862976:0@lo:501: 00000100:00100000:0.0:1788521662.389496:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521662.389548:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fbc3c4000 going to sleep for 11 seconds 00000100:00100000:0.0:1788521662.389560:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816862976 00000100:00100000:0.0:1788521662.389564:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816862976 00000100:00100000:0.0:1788521662.389593:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788521662.389600:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:5830:x1875400816862976:12345-0@lo:501: 00000100:00100000:0.0:1788521662.390233:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:5830:x1875400816862976:12345-0@lo:501: Request processed in 632us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521662.390241:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788521662.390297:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816862976:0@lo:501: 00000100:00100000:0.0:1788521662.390339:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816863104:0@lo:503: 00000100:00100000:0.0:1788521662.390375:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521662.390396:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fbc3c4000 going to sleep for 11 seconds 00000100:00100000:0.0:1788521662.390408:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816863104 00000100:00100000:0.0:1788521662.390412:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816863104 00000100:00100000:0.0:1788521662.390430:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788521662.390436:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:5830:x1875400816863104:12345-0@lo:503: 00000100:00100000:0.0:1788521662.391095:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:5830:x1875400816863104:12345-0@lo:503: Request processed in 657us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521662.391102:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788521662.391404:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816863104:0@lo:503: 00000100:00100000:2.0:1788521662.392676:0:6734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860daa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6734:1875400816863232:0@lo:502: 00000100:00100000:2.0:1788521662.392745:0:6734:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521662.392907:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816863232 00000100:00100000:1.0:1788521662.392914:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816863232 00000100:00100000:1.0:1788521662.392959:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788521662.392968:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:6734:x1875400816863232:12345-0@lo:502: 00000100:00100000:1.0:1788521662.403977:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:6734:x1875400816863232:12345-0@lo:502: Request processed in 11000us (11222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521662.403992:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788521662.409604:0:6734:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f922c1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788521662.409659:0:6734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860daa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6734:1875400816863232:0@lo:502: 00000020:01000000:3.0:1788521662.409703:0:6734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788521662.409712:0:6734:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788521662.409719:0:6734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521662.409721:0:6734:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788521662.409727:0:6734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788521662.409731:0:6734:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.148@tcp to nid 0x20000c0a8ce94 (192.168.206.148@tcp) 00000020:01000000:3.0:1788521662.409752:0:6734:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788521662.409755:0:6734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788521662.409771:0:6734:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff996fae0619c0) 00000020:00000080:3.0:1788521662.409791:0:6734:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788521662.409798:0:6734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788521662.409898:0:6734:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788521662.409904:0:6734:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788521662.409911:0:6734:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b7b50db5927bae2 00010000:00080000:3.0:1788521662.409939:0:6734:0:(ldlm_lib.c:102:import_set_conn()) imp ffff996fb5501800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.148@tcp at head 00010000:00010000:3.0:1788521662.410209:0:6734:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788521662.497271:0:6734:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788521662.497467:0:6734:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788521662.498705:0:6734:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788521662.499014:0:6734:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788521662.499064:0:6734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788521662.499121:0:6734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788521662.499768:0:6739:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788521662.499773:0:6739:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788521662.500704:0:6734:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788521662.500727:0:6734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788521662.500769:0:6734:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788521662.500791:0:6734:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b7b50db5927bae9 00000100:00080000:2.0:1788521662.500802:0:6734:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788521662.500808:0:6734:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff996fb5501800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1788521662.500843:0:6734:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996f860d8a80 x1875400816863360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788521662.500906:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875400816863360:0@lo:8: 00000100:00100000:3.0:1788521662.500970:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788521662.501080:0:6734:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1788521662.501185:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788521662.501194:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816863488:0@lo:400: 00000100:00100000:2.0:1788521662.501226:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521662.501256:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875400816863616:0@lo:400: 00000100:00100000:2.0:1788521662.501278:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521662.501575:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816863488 00000100:00100000:2.0:1788521662.501583:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816863488 00000100:00100000:2.0:1788521662.501621:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816863616 00000100:00100000:2.0:1788521662.501625:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816863616 00000100:00100000:2.0:1788521662.501652:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788521662.501661:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816863488:12345-0@lo:400: 00000100:00100000:2.0:1788521662.501709:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816863488:12345-0@lo:400: Request processed in 48us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521662.501779:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788521662.501798:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788521662.501804:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875400816863616:12345-0@lo:400: 00000100:00100000:2.0:1788521662.501839:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875400816863616:12345-0@lo:400: Request processed in 35us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521662.501845:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788521662.501879:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996f860da300 x1875400816863488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521662.501901:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816863488:0@lo:400: 00010000:00080000:2.0:1788521662.501932:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996f860dbb80 x1875400816863616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521662.501940:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875400816863616:0@lo:400: 00000020:01000000:2.0:1788521662.501995:0:6734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521662.502000:0:6734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521662.502002:0:6734:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788521662.502005:0:6734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521662.502009:0:6734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521662.502010:0:6734:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788521662.502013:0:6734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788521662.502014:0:6734:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788521662.502037:0:6734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860dbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6734:1875400816863744:0@lo:502: 00000100:00100000:2.0:1788521662.502078:0:6734:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521662.502096:0:6734:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f922c1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788521662.502488:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816863360 00000100:00100000:2.0:1788521662.502493:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816863360 00000100:00100000:2.0:1788521662.502576:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788521662.502581:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875400816863360:12345-0@lo:8: 00010000:00080000:2.0:1788521662.502602:0:6687:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 162 last 0 00000020:00000080:2.0:1788521662.502625:0:6687:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b7b50db5927baf0 00002000:00100000:2.0:1788521662.502660:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff996f913e3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788521662.502664:0:6687:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1788521662.502667:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1788521662.502811:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00100000:2.0:1788521662.503445:0:6687:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788521662.503818:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788521662.503850:0:6687:0:(import.c:65:import_set_state_nolock()) ffff996f913e2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788521662.505046:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875400816863360:12345-0@lo:8: Request processed in 2459us (4071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521662.505057:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788521662.511702:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996f860d8a80 x1875400816863360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788521672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521662.511718:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788521662.511737:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788521662.511745:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788521662.511751:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788521662.511754:0:3303:0:(import.c:65:import_set_state_nolock()) ffff996fb5501800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788521662.511779:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788521662.511786:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875400816863360:0@lo:8: 00000100:00100000:3.0:1788521662.511828:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816863744 00000100:00100000:3.0:1788521662.511835:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816863744 00000100:00100000:3.0:1788521662.511877:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788521662.511886:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:6734:x1875400816863744:12345-0@lo:502: 00000100:00100000:3.0:1788521662.512170:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:6734:x1875400816863744:12345-0@lo:502: Request processed in 283us (10089us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521662.512177:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788521662.512251:0:6734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860dbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:6734:1875400816863744:0@lo:502: 00000020:01000000:3.0:1788521662.512279:0:6734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521662.512299:0:6734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521662.512302:0:6734:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788521662.512306:0:6734:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1788521662.512609:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788521662.512626:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788521662.512636:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392ce00/0x1b7b50db5927bacd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bad4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521662.512654:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996f8392ce00/0x1b7b50db5927bacd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bad4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521662.512664:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788521662.512667:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff996f8606b380 from 1 10000000:01000000:3.0:1788521662.512669:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788521662.512701:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392d200/0x1b7b50db5927baf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521662.512709:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996f8392d200/0x1b7b50db5927baf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521662.512731:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f8392d200/0x1b7b50db5927baf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521662.512750:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f8574a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816863872:0@lo:101: 00000100:00100000:3.0:1788521662.512786:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521662.512819:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86759300 going to sleep for 11 seconds 00000100:00100000:3.0:1788521662.512837:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816863872 00000100:00100000:3.0:1788521662.512841:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816863872 00000100:00100000:3.0:1788521662.512864:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788521662.512871:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:5830:x1875400816863872:12345-0@lo:101: 00010000:00010000:3.0:1788521662.512883:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521662.512895:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f8392c600/0x1b7b50db5927bafe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927baf7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521662.512916:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8392c600/0x1b7b50db5927bafe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927baf7 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521662.512939:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f8392c600/0x1b7b50db5927bafe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927baf7 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521662.512947:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392c600, rc 0) 00000100:00100000:3.0:1788521662.512978:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:5830:x1875400816863872:12345-0@lo:101: Request processed in 106us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521662.512985:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788521662.513018:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f8574a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816863872:0@lo:101: 00010000:00010000:3.0:1788521662.513031:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f8392d200/0x1b7b50db5927baf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bafe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521662.513040:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f8392d200/0x1b7b50db5927baf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bafe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521662.513077:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f8574a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816864000:0@lo:501: 00000100:00100000:3.0:1788521662.513098:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521662.513109:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f889fa3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521662.513120:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816864000 00000100:00100000:3.0:1788521662.513123:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816864000 00000100:00100000:3.0:1788521662.513160:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788521662.513167:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:5830:x1875400816864000:12345-0@lo:501: 00000100:00100000:1.0:1788521662.540843:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f8574a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816864000:0@lo:501: 10000000:01000000:1.0:1788521662.540886:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788521662.540897:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392d200/0x1b7b50db5927baf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bafe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521662.540908:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996f8392d200/0x1b7b50db5927baf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bafe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521662.542678:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:5830:x1875400816864000:12345-0@lo:501: Request processed in 26972us (27039us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788521662.542697:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000004:00080000:2.0:1788521662.547223:0:6739:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788521662.547524:0:6739:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 162532380353ns, next at 0ns, rc = 0 00000004:00080000:2.0:1788521662.597015:0:6740:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788521662.597049:0:6740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860dbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6740:1875400816864256:0@lo:7: 00000100:00100000:2.0:1788521662.597121:0:6740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521662.597214:0:6740:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f98b84840 going to sleep for 11 seconds 00000100:00100000:2.0:1788521662.597234:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816864128:0@lo:13: 00000100:00100000:2.0:1788521662.597259:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521662.597324:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816864256 00000100:00100000:2.0:1788521662.597331:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816864256 00000100:00100000:2.0:1788521662.597757:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788521662.597767:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6740:x1875400816864256:12345-0@lo:7: 00000100:00080000:1.0:1788521662.598750:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521662.601595:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816864128 00000100:00100000:2.0:1788521662.601611:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816864128 00000100:00100000:2.0:1788521662.601665:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788521662.601675:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875400816864128:12345-0@lo:13: 00002000:00000024:2.0:1788521662.601698:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:2.0:1788521662.602361:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875400816864128:12345-0@lo:13: Request processed in 686us (5098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521662.602370:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788521662.607267:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996f860da300 x1875400816864128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521678 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521662.607307:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816864128:0@lo:13: 00010000:00010000:0.0:1788521662.610616:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788521662.615801:0:6690:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788521662.615812:0:6690:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788521662.615908:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6740:x1875400816864256:12345-0@lo:7: Request processed in 18138us (18783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521662.615921:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788521662.616284:0:6740:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996f860dbb80 x1875400816864256/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788521678 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521662.616300:0:6740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860dbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6740:1875400816864256:0@lo:7: 00000004:00080000:0.0:1788521662.616326:0:6740:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788521662.616377:0:6740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f58700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6740:1875400816864384:0@lo:5: 00000100:00100000:0.0:1788521662.616413:0:6740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521662.616455:0:6740:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb4584300 going to sleep for 11 seconds 00000100:00100000:3.0:1788521662.616643:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816864384 00000100:00100000:3.0:1788521662.616658:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816864384 00000100:00100000:3.0:1788521662.616708:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788521662.616789:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6740:x1875400816864384:12345-0@lo:5: 00002000:00080000:3.0:1788521662.616841:0:6689:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788521662.616845:0:6689:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788521662.617136:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6740:x1875400816864384:12345-0@lo:5: Request processed in 418us (721us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788521662.617169:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788521662.617203:0:6740:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996fb3f58700 x1875400816864384/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788521678 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521662.617216:0:6740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f58700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6740:1875400816864384:0@lo:5: 00000004:00080000:3.0:1788521662.617226:0:6740:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788521662.617249:0:6740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f8574bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6740:1875400816864512:0@lo:700: 00000100:00100000:3.0:1788521662.617273:0:6740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521662.617290:0:6740:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb7efd840 going to sleep for 11 seconds 00000100:00100000:3.0:1788521662.617327:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816864512 00000100:00100000:3.0:1788521662.617331:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816864512 00000100:00100000:3.0:1788521662.618482:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788521662.618494:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6740:x1875400816864512:12345-0@lo:700: 00000100:00100000:3.0:1788521662.618682:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f8574ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6696:1875400816864640:0@lo:700: 00000100:00100000:3.0:1788521662.618732:0:6696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521662.618766:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb7efdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788521662.619184:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816864640 00000100:00100000:2.0:1788521662.619191:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816864640 00000100:00100000:2.0:1788521662.619226:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788521662.619235:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f8574a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6696:x1875400816864640:12345-0@lo:700: 00000004:00080000:2.0:1788521662.668114:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:2.0:1788521662.726678:0:5840:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1788521662.753131:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f8574a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6696:x1875400816864640:12345-0@lo:700: Request processed in 133887us (134387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521662.753407:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788521662.753897:0:6696:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996f8574ad80 x1875400816864640/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788521678 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521662.753916:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f8574ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6696:1875400816864640:0@lo:700: 40000000:02000000:3.0:1788521662.753931:0:6696:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:0.0:1788521662.886898:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6740:x1875400816864512:12345-0@lo:700: Request processed in 268399us (269615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521662.886918:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788521662.887224:0:6740:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996f8574bb80 x1875400816864512/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788521678 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521662.887241:0:6740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f8574bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6740:1875400816864512:0@lo:700: 00000001:00100000:2.0:1788521662.889226:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788521662.889245:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000004:02000040:2.0:1788521662.988543:0:6740:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1788521662.998916:0:6740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f58380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6740:1875400816864768:0@lo:5: 00000100:00100000:0.0:1788521662.998977:0:6740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521662.999029:0:6740:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb18d7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788521662.999088:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816864768 00000100:00100000:3.0:1788521662.999095:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816864768 00000100:00100000:3.0:1788521662.999167:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788521662.999177:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6740:x1875400816864768:12345-0@lo:5: 00002000:00080000:3.0:1788521663.019349:0:6690:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788521663.019373:0:6690:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1788521663.034616:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6740:x1875400816864768:12345-0@lo:5: Request processed in 35434us (35631us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788521663.034627:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788521663.034693:0:6740:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996fb3f58380 x1875400816864768/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788521678 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521663.034706:0:6740:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788521663.034731:0:6740:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff996fb3f58380 x1875400816864768/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788521678 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521663.034743:0:6740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f58380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6740:1875400816864768:0@lo:5: 00000004:00080000:2.0:1788521663.034757:0:6740:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1788521663.633491:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521664.657857:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521665.679212:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521666.704367:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521667.739665:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521667.918443:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816864896:0@lo:13: 00000100:00100000:0.0:1788521667.918504:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521667.918577:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816864896 00000100:00100000:0.0:1788521667.918584:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816864896 00000100:00100000:0.0:1788521667.918628:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788521667.918636:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875400816864896:12345-0@lo:13: 00002000:00000024:0.0:1788521667.918668:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521667.918707:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875400816864896:12345-0@lo:13: Request processed in 71us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521667.918713:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788521667.918748:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996fb3f59880 x1875400816864896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521683 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521667.918765:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816864896:0@lo:13: 00000100:00080000:1.0:1788521667.920461:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521667.944981:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3305:1875400816865024:0@lo:400: 00000100:00100000:1.0:1788521667.945054:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521667.945247:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816865024 00000100:00100000:3.0:1788521667.945256:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816865024 00000100:00100000:3.0:1788521667.945319:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788521667.945329:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86014c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:3305:x1875400816865024:12345-0@lo:400: 00000100:00100000:3.0:1788521667.945394:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86014c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:3305:x1875400816865024:12345-0@lo:400: Request processed in 67us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521667.945401:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788521667.945446:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3305:1875400816865024:0@lo:400: 00000100:00100000:2.0:1788521667.949373:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875400816865152:0@lo:400: 00000100:00100000:2.0:1788521667.949440:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521667.949486:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788521667.949494:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875400816865280:0@lo:400: 00000100:00100000:2.0:1788521667.949517:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521667.949544:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816865152 00000100:00100000:2.0:1788521667.949550:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816865152 00000100:00100000:2.0:1788521667.949588:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816865280 00000100:00100000:2.0:1788521667.949605:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816865280 00000100:00100000:2.0:1788521667.949633:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788521667.949640:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875400816865152:12345-0@lo:400: 00000100:00100000:2.0:1788521667.949688:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875400816865152:12345-0@lo:400: Request processed in 48us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521667.949694:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788521667.949710:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788521667.949716:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875400816865280:12345-0@lo:400: 00000100:00100000:2.0:1788521667.949744:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875400816865280:12345-0@lo:400: Request processed in 28us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521667.949749:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788521667.949769:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788521667.949793:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996f98072680 x1875400816865280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521667.949807:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875400816865280:0@lo:400: 00010000:00080000:2.0:1788521667.949817:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996f98070700 x1875400816865152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521667.949824:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875400816865152:0@lo:400: 00000001:00080000:0.0:1788521668.128751:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1788521668.750514:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788521668.798813:0:7057:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788521669.774707:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521670.799326:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521671.822578:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521672.848961:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521673.044825:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816865408:0@lo:13: 00000100:00100000:0.0:1788521673.044891:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521673.044960:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816865408 00000100:00100000:0.0:1788521673.044968:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816865408 00000100:00100000:0.0:1788521673.045021:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521673.045030:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816865408:12345-0@lo:13: 00002000:00000024:0.0:1788521673.045061:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521673.045118:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816865408:12345-0@lo:13: Request processed in 88us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521673.045136:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788521673.045179:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788521673.045210:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996fb3f59880 x1875400816865408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521689 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521673.045221:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788521673.045240:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816865408:0@lo:13: 00000100:00100000:0.0:1788521673.051498:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f8574bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3305:1875400816865536:0@lo:400: 00000100:00100000:0.0:1788521673.051564:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521673.055634:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f8574ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875400816865664:0@lo:400: 00000100:00100000:3.0:1788521673.055697:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521673.055744:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788521673.055751:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f8574aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875400816865792:0@lo:400: 00000100:00100000:3.0:1788521673.055786:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521673.055819:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816865664 00000100:00100000:3.0:1788521673.055835:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816865664 00000100:00100000:3.0:1788521673.055872:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816865792 00000100:00100000:3.0:1788521673.055875:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816865792 00000100:00100000:3.0:1788521673.055897:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788521673.055904:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875400816865664:12345-0@lo:400: 00000100:00100000:3.0:1788521673.055965:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875400816865664:12345-0@lo:400: Request processed in 60us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521673.055972:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788521673.055987:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788521673.055994:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f8574a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875400816865792:12345-0@lo:400: 00000100:00100000:3.0:1788521673.056019:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f8574a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875400816865792:12345-0@lo:400: Request processed in 27us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521673.056024:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788521673.056056:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788521673.056081:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996f8574aa00 x1875400816865792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521673.056096:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f8574aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875400816865792:0@lo:400: 00010000:00080000:3.0:1788521673.056107:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996f8574ad80 x1875400816865664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521673.056115:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f8574ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875400816865664:0@lo:400: 00000100:00100000:3.0:1788521673.056223:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816865536 00000100:00100000:3.0:1788521673.056228:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816865536 00000100:00100000:3.0:1788521673.056264:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788521673.056271:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:3305:x1875400816865536:12345-0@lo:400: 00000100:00100000:3.0:1788521673.060569:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:3305:x1875400816865536:12345-0@lo:400: Request processed in 4290us (8996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521673.060597:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788521673.060910:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f8574bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3305:1875400816865536:0@lo:400: 00010000:00010000:2.0:1788521673.874396:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521674.895900:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521675.918377:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521676.950558:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521677.966530:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521678.160320:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816865920:0@lo:400: 00000100:00100000:2.0:1788521678.160382:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521678.160426:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788521678.160431:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816866048:0@lo:400: 00000100:00100000:2.0:1788521678.160453:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521678.160479:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816865920 00000100:00100000:2.0:1788521678.160485:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816865920 00000100:00100000:2.0:1788521678.160520:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788521678.160528:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:3304:x1875400816865920:12345-0@lo:400: 00000100:00100000:2.0:1788521678.160569:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:3304:x1875400816865920:12345-0@lo:400: Request processed in 41us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521678.160576:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788521678.160614:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816865920:0@lo:400: 00000100:00100000:0.0:1788521678.160982:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816866432:0@lo:13: 00000100:00100000:0.0:1788521678.161011:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521678.161037:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816866432 00000100:00100000:0.0:1788521678.161041:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816866432 00000100:00100000:0.0:1788521678.161073:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521678.161079:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816866432:12345-0@lo:13: 00002000:00000024:0.0:1788521678.161104:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521678.161139:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816866432:12345-0@lo:13: Request processed in 59us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521678.161161:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788521678.161181:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788521678.161214:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996fb3f59880 x1875400816866432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521694 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521678.161240:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816866432:0@lo:13: 00000100:00100000:2.0:1788521678.167010:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816866304:0@lo:400: 00000100:00100000:2.0:1788521678.167080:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521678.167126:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788521678.167132:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875400816866176:0@lo:400: 00000100:00100000:2.0:1788521678.167176:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521678.167567:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816866304 00000100:00100000:0.0:1788521678.167584:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816866304 00000100:00100000:0.0:1788521678.167626:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788521678.168097:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816866304:12345-0@lo:400: 00000100:00100000:0.0:1788521678.168184:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816866304:12345-0@lo:400: Request processed in 550us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521678.168192:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788521678.168804:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996f860db100 x1875400816866304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521678.168820:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816866304:0@lo:400: 00000100:00100000:2.0:1788521678.168902:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816866048 00000100:00100000:2.0:1788521678.168909:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816866048 00000100:00100000:2.0:1788521678.168947:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816866176 00000100:00100000:2.0:1788521678.168962:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816866176 00000100:00100000:2.0:1788521678.169003:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788521678.169010:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816866048:12345-0@lo:400: 00000100:00100000:2.0:1788521678.169061:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816866048:12345-0@lo:400: Request processed in 51us (8605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521678.169067:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788521678.169082:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788521678.169088:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875400816866176:12345-0@lo:400: 00000100:00100000:2.0:1788521678.169116:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875400816866176:12345-0@lo:400: Request processed in 29us (1940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521678.169121:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788521678.169175:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996f860d9f80 x1875400816866176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521678.169185:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875400816866176:0@lo:400: 00010000:00080000:0.0:1788521678.169408:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996f860d8700 x1875400816866048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521678.169417:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816866048:0@lo:400: 00000100:00080000:1.0:1788521678.169847:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788521679.003330:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521680.015369:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521681.044584:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788521681.868707:0:7625:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788521681.868711:0:7625:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788521681.868846:0:7625:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff996f86ac1800 00000020:01000004:3.0:1788521681.868862:0:7625:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788521681.868873:0:7625:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788521681.868895:0:7625:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff996fbc57cd40) 00000020:00000080:3.0:1788521681.868913:0:7625:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788521681.886912:0:7625:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788521681.887335:0:7625:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788521681.923034:0:7625:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788521681.938043:0:7625:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788521681.938079:0:7625:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788521681.938136:0:7625:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788521681.938203:0:7625:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788521681.945434:0:7625:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788521681.945605:0:7625:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788521681.945617:0:7625:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1b7b50db5927bb0c 00000020:01000004:2.0:1788521681.945678:0:7625:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788521681.945701:0:7625:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.148@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788521681.945705:0:7625:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788521681.945712:0:7625:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788521681.945795:0:7625:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788521681.945800:0:7625:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.148@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788521681.977019:0:7625:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.148@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788521681.977063:0:7625:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.148@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788521681.977067:0:7625:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788521681.977069:0:7625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788521681.977070:0:7625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788521681.977071:0:7625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788521681.977072:0:7625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788521681.977073:0:7625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788521681.977075:0:7625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788521681.977076:0:7625:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788521681.977078:0:7625:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788521681.977079:0:7625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788521681.977080:0:7625:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788521681.977083:0:7625:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788521681.977086:0:7625:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788521681.977087:0:7625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788521681.977089:0:7625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788521681.977094:0:7625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788521681.977095:0:7625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788521681.977096:0:7625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788521681.977097:0:7625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788521681.977098:0:7625:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788521681.977099:0:7625:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788521681.977100:0:7625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788521681.977101:0:7625:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788521681.977126:0:7625:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788521681.977285:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f8574ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816866560:0@lo:253: 00000100:00100000:0.0:1788521681.977435:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521681.977518:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb47d3180 going to sleep for 11 seconds 00000100:00100000:2.0:1788521681.977786:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816866560 00000100:00100000:2.0:1788521681.977794:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816866560 00000100:00100000:0.0:1788521681.978003:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788521681.978013:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:7625:x1875400816866560:12345-0@lo:253: 20000000:01000000:0.0:1788521681.978056:0:5827:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788521681.978060:0:5827:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788521681.978065:0:5827:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788521681.978068:0:5827:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788521681.979268:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788521681.979703:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788521681.979789:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788521681.979837:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788521681.979846:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788521681.979879:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788521681.980008:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788521681.980813:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788521681.980836:0:5827:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.148@tcp 20000000:01000000:0.0:1788521681.980838:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.148@tcp (null) (null) (null) 00000040:00080000:0.0:1788521681.980884:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788521681.980956:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788521681.981011:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788521681.981020:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.148@tcp (null) (null) 00000040:00080000:0.0:1788521681.981054:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788521681.981063:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788521681.981095:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788521681.981283:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788521681.982356:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788521681.982378:0:5827:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.148@tcp 20000000:01000000:0.0:1788521681.982380:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.148@tcp (null) (null) (null) 00000040:00080000:0.0:1788521681.982413:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788521681.982421:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788521681.982524:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788521681.982533:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.148@tcp (null) (null) 00000040:00080000:0.0:1788521681.982567:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788521681.982575:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788521681.982618:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788521681.982786:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788521681.982804:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788521681.982806:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788521681.982812:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788521681.982814:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788521681.982816:0:5827:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788521681.982827:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788521681.982829:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788521681.982860:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788521681.982862:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788521681.983707:0:7627:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788521681.983847:0:7627:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788521681.983993:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788521681.984495:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1788521681.984541:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1788521681.984579:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1788521681.984593:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788521681.984603:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788521681.985404:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1788521681.985491:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1788521681.985542:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1788521681.985993:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1788521681.986036:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1788521681.986092:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1788521681.986107:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788521681.986109:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788521681.987092:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788521681.989477:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788521681.989530:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788521681.989599:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1788521681.989815:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788521681.989819:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788521681.991255:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1788521681.991326:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1788521681.991381:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788521681.994136:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788521681.994564:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788521681.994640:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:3.0:1788521681.994661:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788521681.994679:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bb13 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521681.994696:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996f8149c600/0x1b7b50db5927ba64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927ba5d expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521681.994704:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996f8149d600/0x1b7b50db5927ba8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927ba87 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521681.994711:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996f8392d000/0x1b7b50db5927bab8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bab1 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521681.994732:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996f80031400/0x1b7b50db5927bad4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bacd expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521681.994739:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996f8392c600/0x1b7b50db5927bafe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927baf7 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521681.994759:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bb13 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521681.994796:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996f8392c600/0x1b7b50db5927bafe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927baf7 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521681.994818:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996f8392c600/0x1b7b50db5927bafe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927baf7 expref: 16 pid: 5828 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521681.994832:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f8574aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1875400816866688:0@lo:104: 00000100:00100000:3.0:1788521681.994904:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788521681.995006:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996f80031400/0x1b7b50db5927bad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927bacd expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521681.995015:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996f80031400/0x1b7b50db5927bad4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927bacd expref: 16 pid: 5826 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521681.995023:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f8574b800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1875400816866816:0@lo:104: 00010000:00010000:3.0:1788521681.995049:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996f8392d000/0x1b7b50db5927bab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927bab1 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521681.995062:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996f8392d000/0x1b7b50db5927bab8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927bab1 expref: 16 pid: 5827 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521681.995070:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f8574b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1875400816866944:0@lo:104: 00010000:00010000:3.0:1788521681.995093:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996f8149d600/0x1b7b50db5927ba8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927ba87 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521681.995101:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996f8149d600/0x1b7b50db5927ba8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927ba87 expref: 16 pid: 5828 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521681.995120:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85749f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1875400816867072:0@lo:104: 00010000:00010000:3.0:1788521681.995172:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996f8149c600/0x1b7b50db5927ba64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927ba5d expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521681.995180:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996f8149c600/0x1b7b50db5927ba64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927ba5d expref: 16 pid: 5827 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521681.995188:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f8574b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1875400816867200:0@lo:104: 00000100:00100000:3.0:1788521681.995214:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb47d3900 going to sleep for 11 seconds 00000100:00100000:0.0:1788521681.997362:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788521681.997395:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521681.997417:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521681.997426:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521681.997434:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521681.997446:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816866688 00000100:00100000:0.0:1788521681.997453:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816866688 00000100:00100000:0.0:1788521681.997486:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816866816 00000100:00100000:0.0:1788521681.997489:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816866816 00000100:00100000:0.0:1788521681.997498:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816866944 00000100:00100000:0.0:1788521681.997500:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816866944 00000100:00100000:0.0:1788521681.997507:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816867072 00000100:00100000:0.0:1788521681.997509:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816867072 00000100:00100000:0.0:1788521681.997516:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816867200 00000100:00100000:0.0:1788521681.997517:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816867200 00000100:00100000:0.0:1788521681.997528:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788521681.997535:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86125c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+7:5827:x1875400816866688:12345-0@lo:104: 00010000:00010000:0.0:1788521681.997550:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996f8392d200/0x1b7b50db5927baf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bafe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521681.997691:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f8574aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1875400816866688:0@lo:104: 00010000:00010000:0.0:1788521681.997789:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788521681.997797:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86125c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+7:5827:x1875400816866688:12345-0@lo:104: Request processed in 262us (2894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521681.997804:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788521681.997839:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788521681.997845:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+6:5827:x1875400816866816:12345-0@lo:104: 00010000:00010000:0.0:1788521681.997852:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996f8392ce00/0x1b7b50db5927bacd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bad4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521681.997969:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1788521681.997970:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1788521681.997975:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+6:5827:x1875400816866816:12345-0@lo:104: Request processed in 131us (581us total) trans 0 rc 0/0 00010000:00010000:2.0:1788521681.997977:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f8392d200/0x1b7b50db5927baf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bafe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521681.997981:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1788521681.997984:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392d200 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:2.0:1788521681.997989:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f8392d200/0x1b7b50db5927baf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927bafe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521681.997995:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1788521681.997997:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f8392d200/0x1b7b50db5927baf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927bafe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521681.998000:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+5:5827:x1875400816866944:12345-0@lo:104: 10000000:00010000:2.0:1788521681.998005:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f8392d200/0x1b7b50db5927baf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927bafe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521681.998008:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996f829d4200/0x1b7b50db5927bab1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bab8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521681.998011:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521681.998033:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788521681.998037:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+5:5827:x1875400816866944:12345-0@lo:104: Request processed in 38us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521681.998042:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1788521681.998043:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f8392d200/0x1b7b50db5927baf7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bafe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521681.998050:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788521681.998053:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788521681.998058:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+4:5827:x1875400816867072:12345-0@lo:104: 00010000:00010000:0.0:1788521681.998064:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927ba87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927ba8e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521681.998065:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f8392d200/0x1b7b50db5927baf7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bafe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521681.998073:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f8392d200/0x1b7b50db5927baf7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bafe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521681.998085:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788521681.998087:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f8392ce00/0x1b7b50db5927bacd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bad4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521681.998093:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392ce00 already unused, calling callback (ffffffffc1cbec20) 00010000:00010000:0.0:1788521681.998094:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788521681.998098:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+4:5827:x1875400816867072:12345-0@lo:104: Request processed in 41us (671us total) trans 0 rc 0/0 10000000:00010000:2.0:1788521681.998102:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f8392ce00/0x1b7b50db5927bacd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927bad4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521681.998104:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1788521681.998109:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f8392ce00/0x1b7b50db5927bacd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927bad4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521681.998115:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f8392ce00/0x1b7b50db5927bacd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927bad4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521681.998115:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 10000000:01000000:2.0:1788521681.998120:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788521681.998121:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+3:5827:x1875400816867200:12345-0@lo:104: 00010000:00010000:0.0:1788521681.998127:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996f8392da00/0x1b7b50db5927ba5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927ba64 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521681.998133:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f8392ce00/0x1b7b50db5927bacd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bad4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521681.998138:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521681.998166:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f8392ce00/0x1b7b50db5927bacd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bad4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521681.998167:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788521681.998172:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+3:5827:x1875400816867200:12345-0@lo:104: Request processed in 51us (737us total) trans 0 rc 0/0 00010000:00010000:2.0:1788521681.998173:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f8392ce00/0x1b7b50db5927bacd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bad4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521681.998178:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788521681.998182:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788521681.998185:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f829d4200/0x1b7b50db5927bab1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bab8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521681.998191:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d4200 already unused, calling callback (ffffffffc1cbec20) 00010000:00010000:0.0:1788521681.998192:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:2.0:1788521681.998194:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f829d4200/0x1b7b50db5927bab1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927bab8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521681.998200:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f829d4200/0x1b7b50db5927bab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927bab8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521681.998229:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f829d4200/0x1b7b50db5927bab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927bab8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521681.998235:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788521681.998253:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f829d4200/0x1b7b50db5927bab1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bab8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521681.998254:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f8574b800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1875400816866816:0@lo:104: 00010000:00010000:2.0:1788521681.998265:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788521681.998269:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f8574b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1875400816866944:0@lo:104: 00010000:00010000:2.0:1788521681.998272:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f829d4200/0x1b7b50db5927bab1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bab8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521681.998279:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85749f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1875400816867072:0@lo:104: 00010000:00010000:2.0:1788521681.998286:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f829d4200/0x1b7b50db5927bab1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bab8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521681.998291:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f8574b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1875400816867200:0@lo:104: 00010000:00010000:2.0:1788521681.998306:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521681.998310:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f8392da00/0x1b7b50db5927ba5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927ba64 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521681.998316:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392da00 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:2.0:1788521681.998319:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f8392da00/0x1b7b50db5927ba5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927ba64 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521681.998321:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bb13 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521681.998333:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f8392da00/0x1b7b50db5927ba5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927ba64 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521681.998342:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f8392da00/0x1b7b50db5927ba5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927ba64 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521681.998347:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788521681.998368:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f8392da00/0x1b7b50db5927ba5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927ba64 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521681.998373:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521681.998378:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f8392da00/0x1b7b50db5927ba5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927ba64 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521681.998384:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f8392da00/0x1b7b50db5927ba5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927ba64 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521681.998393:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521681.998394:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521681.998396:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521681.998417:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3305:1875400816867328:0@lo:103: 00000100:00100000:0.0:1788521681.998417:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816867712:0@lo:103: 00000100:00100000:2.0:1788521681.998446:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521681.998500:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816867456:0@lo:103: 00000100:00100000:0.0:1788521681.998512:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521681.998526:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816867584:0@lo:103: 00000100:00100000:0.0:1788521681.998544:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816867328 00000100:00100000:2.0:1788521681.998545:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521681.998548:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816867328 00000100:00100000:1.0:1788521681.998566:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816867712 00010000:00010000:0.0:1788521681.998568:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996f8392c600/0x1b7b50db5927bafe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927baf7 expref: 17 pid: 5828 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521681.998573:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816867712 00000100:00100000:2.0:1788521681.998582:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816867584 00000100:00100000:2.0:1788521681.998585:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816867584 00000100:00100000:0.0:1788521681.998588:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788521681.998595:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996f8149c600/0x1b7b50db5927ba64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927ba5d expref: 19 pid: 5827 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521681.998596:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3305:x1875400816867328:12345-0@lo:103: 00010000:00010000:2.0:1788521681.998602:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996f8392d000/0x1b7b50db5927bab8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bab1 expref: 19 pid: 5827 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521681.998609:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521681.998616:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996f8392c600/0x1b7b50db5927bafe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927baf7 expref: 19 pid: 5828 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521681.998626:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788521681.998627:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788521681.998635:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788521681.998640:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788521681.998648:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3304:x1875400816867712:12345-0@lo:103: 00010000:00010000:2.0:1788521681.998657:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521681.998662:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996f8149c600/0x1b7b50db5927ba64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927ba5d expref: 19 pid: 5827 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521681.998685:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996f8149c600/0x1b7b50db5927ba64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927ba5d expref: 19 pid: 5827 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521681.998699:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8149c600/0x1b7b50db5927ba64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927ba5d expref: 19 pid: 5827 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521681.998711:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521681.998745:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:3304:x1875400816867712:12345-0@lo:103: Request processed in 99us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521681.998751:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788521681.998764:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788521681.998770:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788521681.998775:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:3307:x1875400816867584:12345-0@lo:103: 00010000:00010000:2.0:1788521681.998782:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521681.998786:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996f8392d000/0x1b7b50db5927bab8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bab1 expref: 17 pid: 5827 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521681.998800:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996f8392c600/0x1b7b50db5927bafe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927baf7 expref: 17 pid: 5828 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521681.998837:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816867712:0@lo:103: 00000100:00100000:3.0:1788521682.002005:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788521682.003306:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996f8392d000/0x1b7b50db5927bab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927bab1 expref: 17 pid: 5827 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521682.003324:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816867456 00010000:00010000:2.0:1788521682.003332:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8392d000/0x1b7b50db5927bab8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927bab1 expref: 17 pid: 5827 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521682.003333:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816867456 00010000:00010000:0.0:1788521682.003336:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8392c600/0x1b7b50db5927bafe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927baf7 expref: 17 pid: 5828 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.003349:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788521682.003369:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996f80031400/0x1b7b50db5927bad4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bacd expref: 16 pid: 5826 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521682.003445:0:7632:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1788521682.003452:0:7632:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:0.0:1788521682.003594:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:3305:x1875400816867328:12345-0@lo:103: Request processed in 4999us (5145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521682.003602:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788521682.003623:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788521682.003631:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85748000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:3306:x1875400816867456:12345-0@lo:103: 00010000:00010000:0.0:1788521682.003646:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521682.003651:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996f80031400/0x1b7b50db5927bad4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bacd expref: 15 pid: 5826 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521682.007859:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521682.007979:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:3307:x1875400816867584:12345-0@lo:103: Request processed in 9199us (9428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521682.007991:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788521682.008176:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3305:1875400816867328:0@lo:103: 00000100:00100000:1.0:1788521682.008421:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816867584:0@lo:103: 00010000:00010000:0.0:1788521682.008443:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996f80031400/0x1b7b50db5927bad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927bacd expref: 14 pid: 5826 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.008466:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f80031400/0x1b7b50db5927bad4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927bacd expref: 14 pid: 5826 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.008477:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521682.008558:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85748000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:3306:x1875400816867456:12345-0@lo:103: Request processed in 4927us (6560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521682.008565:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1788521682.008676:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521682.008679:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521682.008681:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521682.008721:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927ba87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927ba8e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.008747:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d5600 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:0.0:1788521682.008751:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927ba87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927ba8e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.008761:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927ba87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927ba8e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521682.008769:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927ba87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927ba8e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521682.008775:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521682.008815:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927ba87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927ba8e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.008821:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521682.008837:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927ba87 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927ba8e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.008844:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927ba87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927ba8e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.008859:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521682.008860:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521682.008862:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521682.008872:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3305:1875400816867840:0@lo:103: 00000100:00100000:0.0:1788521682.008905:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521682.008945:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816867840 00000100:00100000:0.0:1788521682.008950:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816867840 00010000:00010000:0.0:1788521682.008968:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996f8149d600/0x1b7b50db5927ba8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927ba87 expref: 13 pid: 5828 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521682.008997:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788521682.009004:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:3305:x1875400816867840:12345-0@lo:103: 00010000:00010000:0.0:1788521682.009015:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521682.009020:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996f8149d600/0x1b7b50db5927ba8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927ba87 expref: 13 pid: 5828 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.009032:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996f8149d600/0x1b7b50db5927ba8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927ba87 expref: 13 pid: 5828 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.009044:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8149d600/0x1b7b50db5927ba8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927ba87 expref: 13 pid: 5828 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.009056:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bb13 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.009065:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bb13 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.009078:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bb13 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.009085:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bb13 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.009092:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bb13 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.009097:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bb13 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.009111:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392c800 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521682.009116:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bb13 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.009124:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bb13 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.009137:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bb13 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.009167:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521682.009193:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:3305:x1875400816867840:12345-0@lo:103: Request processed in 189us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521682.009200:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788521682.009238:0:5827:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bb13 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.009247:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bb13 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.009254:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bb13 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788521682.009267:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788521682.009581:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3305:1875400816867840:0@lo:103: 00000100:00100000:3.0:1788521682.012090:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816867456:0@lo:103: 00010000:00010000:0.0:1788521682.063958:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521682.093491:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+11:7625:x1875400816866560:12345-0@lo:253: Request processed in 115472us (116048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521682.093504:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788521682.093599:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f8574ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816866560:0@lo:253: 10000000:01000000:0.0:1788521682.093615:0:7625:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788521682.093630:0:7625:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788521682.093632:0:7625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788521682.093633:0:7625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788521682.093634:0:7625:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788521682.093635:0:7625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788521682.093636:0:7625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788521682.093637:0:7625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788521682.093639:0:7625:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788521682.093640:0:7625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788521682.093641:0:7625:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788521682.093663:0:7625:0:(tgt_mount.c:101:server_register_mount()) register mount ffff996f86ac1800 from lustre-OST0001 10000000:01000000:0.0:1788521682.093685:0:7625:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788521682.093687:0:7625:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788521682.093694:0:7625:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff996f8606b380 local copy 10000000:01000000:0.0:1788521682.093697:0:7625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788521682.093730:0:7625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f80031400/0x1b7b50db5927bb1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.093741:0:7625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.148@tcp lock: ffff996f80031400/0x1b7b50db5927bb1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.093751:0:7625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f80031400/0x1b7b50db5927bb1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521682.093768:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f59c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816867968:0@lo:101: 00000100:00100000:0.0:1788521682.093803:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521682.093840:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90f00780 going to sleep for 11 seconds 00000100:00100000:2.0:1788521682.093901:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816867968 00000100:00100000:2.0:1788521682.093915:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816867968 00000100:00100000:2.0:1788521682.093967:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788521682.093975:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+11:7625:x1875400816867968:12345-0@lo:101: 00010000:00010000:2.0:1788521682.093987:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521682.093999:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f8149c600/0x1b7b50db5927bb21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927bb1a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521682.094021:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8149c600/0x1b7b50db5927bb21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927bb1a expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521682.094032:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f8149c600/0x1b7b50db5927bb21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bb1a expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521682.094041:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8149c600, rc 0) 00000100:00100000:2.0:1788521682.094079:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:7625:x1875400816867968:12345-0@lo:101: Request processed in 104us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521682.094085:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788521682.094193:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f59c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816867968:0@lo:101: 00010000:00010000:0.0:1788521682.094213:0:7625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f80031400/0x1b7b50db5927bb1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1b7b50db5927bb21 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.094221:0:7625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f80031400/0x1b7b50db5927bb1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1b7b50db5927bb21 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521682.094325:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f59c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816868096:0@lo:501: 00000100:00100000:0.0:1788521682.094351:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521682.094368:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90f00780 going to sleep for 11 seconds 00000100:00100000:2.0:1788521682.094534:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816868096 00000100:00100000:2.0:1788521682.094539:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816868096 00000100:00100000:2.0:1788521682.094572:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788521682.094578:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:7625:x1875400816868096:12345-0@lo:501: 00000100:00100000:2.0:1788521682.094780:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:7625:x1875400816868096:12345-0@lo:501: Request processed in 201us (428us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788521682.094787:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788521682.094819:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f59c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816868096:0@lo:501: 10000000:01000000:2.0:1788521682.094832:0:7625:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788521682.094857:0:7625:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788521682.094863:0:7625:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f80031400/0x1b7b50db5927bb1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1b7b50db5927bb21 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521682.094876:0:7625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f80031400/0x1b7b50db5927bb1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1b7b50db5927bb21 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521682.094883:0:7625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff996f80031400/0x1b7b50db5927bb1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1b7b50db5927bb21 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521682.094900:0:7625:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788521682.094919:0:7625:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff996f86ac1800 10000000:01000000:2.0:1788521682.094924:0:7625:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788521682.094929:0:7625:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788521682.094931:0:7625:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788521682.094936:0:7625:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788521682.094939:0:7625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788521682.094955:0:7625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8149d600/0x1b7b50db5927bb28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521682.094962:0:7625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996f8149d600/0x1b7b50db5927bb28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521682.094969:0:7625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f8149d600/0x1b7b50db5927bb28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521682.094980:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816868224:0@lo:101: 00000100:00100000:2.0:1788521682.095007:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521682.095022:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f988239c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788521682.095035:0:7631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521682.095040:0:7631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f80031400/0x1b7b50db5927bb1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1b7b50db5927bb21 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521682.095055:0:7631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80031400 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:2.0:1788521682.095059:0:7631:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f80031400/0x1b7b50db5927bb1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1b7b50db5927bb21 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521682.095067:0:7631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f80031400/0x1b7b50db5927bb1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x1b7b50db5927bb21 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521682.095074:0:7631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f80031400/0x1b7b50db5927bb1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x1b7b50db5927bb21 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521682.095079:0:7631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788521682.095099:0:7631:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f80031400/0x1b7b50db5927bb1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1b7b50db5927bb21 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521682.095104:0:7631:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521682.095120:0:7631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f80031400/0x1b7b50db5927bb1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1b7b50db5927bb21 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521682.095127:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f80031400/0x1b7b50db5927bb1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1b7b50db5927bb21 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521682.095139:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521682.095187:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521682.095189:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521682.095196:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788521682.095216:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816868352:0@lo:103: 00000100:00100000:2.0:1788521682.095357:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521682.095400:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816868224 00000100:00100000:2.0:1788521682.095404:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816868224 00000100:00100000:2.0:1788521682.095429:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788521682.095434:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:7625:x1875400816868224:12345-0@lo:101: 00010000:00010000:2.0:1788521682.095441:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521682.095451:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f8149d400/0x1b7b50db5927bb2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927bb28 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521682.095466:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8149d400/0x1b7b50db5927bb2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927bb28 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521682.095475:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f8149d400/0x1b7b50db5927bb2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bb28 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521682.095480:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8149d400, rc 0) 00000100:00100000:2.0:1788521682.095509:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:7625:x1875400816868224:12345-0@lo:101: Request processed in 74us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521682.095516:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788521682.095548:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816868224:0@lo:101: 00010000:00010000:2.0:1788521682.095558:0:7625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f8149d600/0x1b7b50db5927bb28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bb2f expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521682.095566:0:7625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f8149d600/0x1b7b50db5927bb28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bb2f expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521682.095624:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816868480:0@lo:501: 00000100:00100000:2.0:1788521682.095649:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521682.095662:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f988239c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521682.095673:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816868480 00000100:00100000:2.0:1788521682.095676:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816868480 00000100:00100000:2.0:1788521682.095693:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788521682.095703:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:7625:x1875400816868480:12345-0@lo:501: 00000100:00100000:2.0:1788521682.095871:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:7625:x1875400816868480:12345-0@lo:501: Request processed in 168us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521682.095878:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788521682.095907:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816868480:0@lo:501: 00000100:00100000:3.0:1788521682.096127:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816868352 00000100:00100000:3.0:1788521682.096132:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816868352 00000100:00100000:3.0:1788521682.096191:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788521682.096199:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:3307:x1875400816868352:12345-0@lo:103: 00010000:00010000:3.0:1788521682.096218:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521682.096230:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8149c600/0x1b7b50db5927bb21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b7b50db5927bb1a expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521682.096250:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521682.096287:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:3307:x1875400816868352:12345-0@lo:103: Request processed in 89us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521682.096294:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788521682.096319:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816868352:0@lo:103: 00000100:00100000:2.0:1788521682.096499:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816868608:0@lo:503: 00000100:00100000:2.0:1788521682.096538:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521682.096568:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f988239c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521682.096627:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816868608 00000100:00100000:0.0:1788521682.096631:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816868608 00000100:00100000:0.0:1788521682.096662:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788521682.096669:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:7625:x1875400816868608:12345-0@lo:503: 00000100:00100000:0.0:1788521682.096808:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:7625:x1875400816868608:12345-0@lo:503: Request processed in 138us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521682.096814:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788521682.096897:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816868608:0@lo:503: 00000040:00080000:2.0:1788521682.097127:0:7625:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788521682.097509:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816868736:0@lo:502: 00000100:00100000:2.0:1788521682.097544:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521682.097572:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f988239c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521682.097627:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816868736 00000100:00100000:3.0:1788521682.097632:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816868736 00000100:00100000:3.0:1788521682.097663:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788521682.097670:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:7625:x1875400816868736:12345-0@lo:502: 00000100:00100000:3.0:1788521682.097811:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:7625:x1875400816868736:12345-0@lo:502: Request processed in 141us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521682.097818:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788521682.097858:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816868736:0@lo:502: 00000040:00080000:3.0:1788521682.098094:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788521682.098135:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788521682.098383:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788521682.098435:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788521682.098473:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788521682.098503:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788521682.098526:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816868864:0@lo:502: 00000100:00100000:3.0:1788521682.098562:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521682.098626:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb47d3300 going to sleep for 11 seconds 00000100:00100000:2.0:1788521682.098758:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816868864 00000100:00100000:2.0:1788521682.098764:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816868864 00000100:00100000:2.0:1788521682.098802:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788521682.098810:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:7625:x1875400816868864:12345-0@lo:502: 00000100:00100000:2.0:1788521682.098952:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:7625:x1875400816868864:12345-0@lo:502: Request processed in 143us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521682.098958:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788521682.099119:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816868864:0@lo:502: 00000040:00080000:3.0:1788521682.099361:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788521682.099372:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1788521682.100324:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788521682.100332:0:7636:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788521682.100338:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521682.100347:0:7636:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788521682.100355:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788521682.100369:0:7636:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff996fbc57b380) 00000020:00000080:3.0:1788521682.100390:0:7636:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788521682.100395:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788521682.100460:0:7636:0:(tgt_mount.c:153:server_get_mount()) get mount ffff996f86ac1800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788521682.100467:0:7636:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788521682.100473:0:7636:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1b7b50db5927bb3d 00010000:00010000:2.0:1788521682.109661:0:7636:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1788521682.109966:0:7636:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788521682.121727:0:7636:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788521682.122020:0:7636:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1788521682.131327:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788521682.131773:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788521682.141479:0:7636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788521682.141491:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521682.141498:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521682.141500:0:7636:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788521682.142299:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521682.142307:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521682.142309:0:7636:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788521682.142314:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788521682.142316:0:7636:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788521682.142369:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521682.142373:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521682.142374:0:7636:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788521682.142378:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788521682.144259:0:7625:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788521682.144298:0:7625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788521682.144323:0:7625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8149d600/0x1b7b50db5927bb28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bb2f expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521682.144336:0:7625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996f8149d600/0x1b7b50db5927bb28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bb2f expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521682.144344:0:7625:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff996f86ac1800 from 1 10000000:01000000:3.0:1788521682.144346:0:7625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788521682.144380:0:7625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392de00/0x1b7b50db5927bb44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521682.144388:0:7625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996f8392de00/0x1b7b50db5927bb44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521682.144400:0:7625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f8392de00/0x1b7b50db5927bb44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521682.144422:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816868992:0@lo:101: 00000100:00100000:3.0:1788521682.144485:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521682.144663:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb47d39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521682.144688:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816868992 00000100:00100000:3.0:1788521682.144702:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816868992 00000100:00100000:3.0:1788521682.144745:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788521682.144754:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:7625:x1875400816868992:12345-0@lo:101: 00010000:00010000:3.0:1788521682.144766:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521682.144777:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bb4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927bb44 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521682.144801:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bb4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927bb44 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521682.144812:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bb4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bb44 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521682.144821:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392c800, rc 0) 00000100:00100000:3.0:1788521682.144859:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:7625:x1875400816868992:12345-0@lo:101: Request processed in 107us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521682.144865:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788521682.144914:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816868992:0@lo:101: 00010000:00010000:3.0:1788521682.144928:0:7625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f8392de00/0x1b7b50db5927bb44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bb4b expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521682.144938:0:7625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f8392de00/0x1b7b50db5927bb44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bb4b expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521682.145027:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816869120:0@lo:501: 00000100:00100000:3.0:1788521682.145052:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521682.145065:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb47d39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521682.145286:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816869120 00000100:00100000:0.0:1788521682.145297:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816869120 00000100:00100000:0.0:1788521682.145340:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788521682.145353:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:7625:x1875400816869120:12345-0@lo:501: 00000100:00100000:0.0:1788521682.146199:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:7625:x1875400816869120:12345-0@lo:501: Request processed in 851us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521682.146219:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788521682.146329:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816869120:0@lo:501: 00000100:00100000:3.0:1788521682.146375:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816869248:0@lo:503: 00000100:00100000:3.0:1788521682.146418:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521682.146442:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb47d39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521682.146590:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816869248 00000100:00100000:0.0:1788521682.146597:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816869248 00000100:00100000:0.0:1788521682.146629:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788521682.146636:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:7625:x1875400816869248:12345-0@lo:503: 00000100:00100000:0.0:1788521682.146922:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:7625:x1875400816869248:12345-0@lo:503: Request processed in 285us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521682.146930:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788521682.147135:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816869248:0@lo:503: 00000040:00080000:3.0:1788521682.147424:0:7625:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788521682.147490:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816869376:0@lo:502: 00000100:00100000:3.0:1788521682.147530:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521682.148697:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb47d39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521682.149297:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816869376 00000100:00100000:0.0:1788521682.149305:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816869376 00000100:00100000:0.0:1788521682.149346:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788521682.149354:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:7625:x1875400816869376:12345-0@lo:502: 00000100:00100000:0.0:1788521682.150345:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:7625:x1875400816869376:12345-0@lo:502: Request processed in 990us (2813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521682.150353:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788521682.150358:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816869376:0@lo:502: 00000040:00080000:3.0:1788521682.150636:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788521682.150688:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788521682.150721:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816869504:0@lo:502: 00000100:00100000:3.0:1788521682.150764:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521682.151107:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816869504 00000100:00100000:2.0:1788521682.151114:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816869504 00000100:00100000:3.0:1788521682.151120:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb47d39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521682.151329:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788521682.151339:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:7625:x1875400816869504:12345-0@lo:502: 00000100:00100000:0.0:1788521682.152051:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:7625:x1875400816869504:12345-0@lo:502: Request processed in 710us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521682.152058:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788521682.152435:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816869504:0@lo:502: 00000040:00080000:1.0:1788521682.152563:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788521682.152577:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788521682.153198:0:7640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788521682.153218:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521682.153220:0:7640:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788521682.153227:0:7640:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff996f86ac1800 00000020:00000080:1.0:1788521682.153229:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788521682.153259:0:7640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788521682.153262:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521682.153264:0:7640:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788521682.153266:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788521682.153591:0:7625:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788521682.153611:0:7625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788521682.153637:0:7625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392de00/0x1b7b50db5927bb44 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bb4b expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.153648:0:7625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996f8392de00/0x1b7b50db5927bb44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bb4b expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521682.153686:0:7625:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788521682.153689:0:7625:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff996f86ac1800 10000000:01000000:0.0:1788521682.153692:0:7625:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff996f86ac1800 10000000:01000000:0.0:1788521682.153696:0:7625:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788521682.153701:0:7625:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff996f86ac1800 from 1 10000000:01000000:0.0:1788521682.153703:0:7625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788521682.153732:0:7625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f80030a00/0x1b7b50db5927bb52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.153740:0:7625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996f80030a00/0x1b7b50db5927bb52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.153750:0:7625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f80030a00/0x1b7b50db5927bb52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521682.153767:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816869632:0@lo:101: 00000100:00100000:0.0:1788521682.153809:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521682.153845:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90f009c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521682.153900:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816869632 00000100:00100000:2.0:1788521682.153905:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816869632 00000100:00100000:2.0:1788521682.153955:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788521682.153970:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:7625:x1875400816869632:12345-0@lo:101: 00010000:00010000:2.0:1788521682.153982:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521682.153993:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f8149dc00/0x1b7b50db5927bb59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927bb52 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521682.154024:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8149dc00/0x1b7b50db5927bb59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927bb52 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521682.154033:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f8149dc00/0x1b7b50db5927bb59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bb52 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521682.154040:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8149dc00, rc 0) 00000100:00100000:2.0:1788521682.154076:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:7625:x1875400816869632:12345-0@lo:101: Request processed in 104us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521682.154083:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788521682.154326:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816869632:0@lo:101: 00010000:00010000:0.0:1788521682.154338:0:7625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f80030a00/0x1b7b50db5927bb52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bb59 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.154352:0:7625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f80030a00/0x1b7b50db5927bb52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bb59 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521682.154439:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816869760:0@lo:501: 00000100:00100000:0.0:1788521682.154464:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521682.154490:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90f009c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521682.154528:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816869760 00000100:00100000:1.0:1788521682.154533:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816869760 00000100:00100000:1.0:1788521682.154564:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788521682.154571:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:7625:x1875400816869760:12345-0@lo:501: 00000100:00100000:1.0:1788521682.154888:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:7625:x1875400816869760:12345-0@lo:501: Request processed in 316us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521682.154896:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788521682.161413:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816869760:0@lo:501: 00000100:00100000:3.0:1788521682.161539:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816869888:0@lo:503: 00000100:00100000:3.0:1788521682.161616:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521682.161659:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb47d3480 going to sleep for 11 seconds 00000100:00100000:1.0:1788521682.161762:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816869888 00000100:00100000:1.0:1788521682.161770:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816869888 00000100:00100000:1.0:1788521682.161820:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788521682.161831:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:7625:x1875400816869888:12345-0@lo:503: 00000100:00100000:1.0:1788521682.162026:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:7625:x1875400816869888:12345-0@lo:503: Request processed in 196us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521682.162033:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788521682.162671:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816869888:0@lo:503: 00000040:00080000:3.0:1788521682.162947:0:7625:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788521682.163711:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816870016:0@lo:502: 00000100:00100000:3.0:1788521682.163774:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521682.163812:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb47d3480 going to sleep for 11 seconds 00000100:00100000:1.0:1788521682.164005:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816870016 00000100:00100000:1.0:1788521682.164012:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816870016 00000100:00100000:1.0:1788521682.164053:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788521682.164062:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:7625:x1875400816870016:12345-0@lo:502: 00000100:00100000:1.0:1788521682.164321:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:7625:x1875400816870016:12345-0@lo:502: Request processed in 259us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521682.164330:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788521682.164352:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816870016:0@lo:502: 00000040:00080000:0.0:1788521682.164639:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788521682.164689:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788521682.164724:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788521682.164787:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788521682.164826:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788521682.164883:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788521682.164908:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788521682.164924:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788521682.164959:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788521682.164995:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788521682.165031:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788521682.165094:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788521682.165115:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788521682.165130:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788521682.165219:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788521682.165258:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788521682.165293:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788521682.165341:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788521682.165378:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788521682.165504:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788521682.165557:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788521682.165594:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788521682.165696:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788521682.165762:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788521682.165799:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788521682.165833:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788521682.165869:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788521682.165901:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1788521682.165918:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788521682.165943:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1788521682.165961:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1788521682.165976:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1788521682.165991:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1788521682.166013:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1788521682.166030:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1788521682.166125:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1788521682.166451:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1788521682.166490:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816870144:0@lo:502: 00000100:00100000:0.0:1788521682.166550:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521682.166591:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90f009c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521682.166671:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816870144 00000100:00100000:3.0:1788521682.166677:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816870144 00000100:00100000:3.0:1788521682.166722:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788521682.166741:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:7625:x1875400816870144:12345-0@lo:502: 00000100:00100000:3.0:1788521682.167893:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:7625:x1875400816870144:12345-0@lo:502: Request processed in 1160us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521682.167903:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788521682.168039:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816870144:0@lo:502: 00000040:00080000:0.0:1788521682.168340:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1788521682.168570:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788521682.169481:0:7641:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788521682.169494:0:7641:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff996fbc578000) 00000020:00000080:3.0:1788521682.169589:0:7641:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1788521682.169722:0:7641:0:(tgt_mount.c:153:server_get_mount()) get mount ffff996f86ac1800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788521682.169726:0:7641:0:(tgt_mount.c:187:server_put_mount()) put mount ffff996f86ac1800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788521682.169729:0:7641:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996f86ac1800 3 00010000:00080000:3.0:1788521682.169757:0:7641:0:(ldlm_lib.c:102:import_set_conn()) imp ffff996fad74f000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.148@tcp at head 00010000:00010000:3.0:1788521682.172724:0:7641:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1788521682.173075:0:7641:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788521682.173126:0:7641:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788521682.173138:0:7641:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x1b7b50db5927bb67 00000100:00080000:3.0:1788521682.173169:0:7641:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788521682.173176:0:7641:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff996fad74f000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1788521682.173221:0:7641:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996f8574ad80 x1875400816870272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788521682.173248:0:7641:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788521682.173577:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f8574ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875400816870272:0@lo:38: 00000100:00100000:2.0:1788521682.173660:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521682.173897:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816870272 00000100:00100000:3.0:1788521682.173906:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816870272 00000100:00100000:3.0:1788521682.173943:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788521682.173951:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3303:x1875400816870272:12345-0@lo:38: 00010000:00080000:3.0:1788521682.173973:0:5834:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:3.0:1788521682.174019:0:5834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1b7b50db5927bb6e 00000004:00100000:3.0:1788521682.174034:0:5834:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788521682.174074:0:5834:0:(import.c:65:import_set_state_nolock()) ffff996fbc6b4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788521682.174131:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875400816870272:12345-0@lo:38: Request processed in 179us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521682.174138:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788521682.174193:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996f8574ad80 x1875400816870272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788521692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521682.174213:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788521682.174221:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788521682.174227:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788521682.174231:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788521682.174234:0:3303:0:(import.c:65:import_set_state_nolock()) ffff996fad74f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788521682.174240:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f8574ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875400816870272:0@lo:38: 00000100:00100000:3.0:1788521682.174262:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875400816870400:0@lo:400: 00000100:00100000:3.0:1788521682.174327:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521682.174378:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816870400 00000100:00100000:1.0:1788521682.174383:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816870400 00000100:00100000:1.0:1788521682.174424:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788521682.174432:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f8574ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875400816870400:12345-0@lo:400: 00000100:00100000:1.0:1788521682.174471:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f8574ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875400816870400:12345-0@lo:400: Request processed in 40us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521682.174477:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788521682.175114:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996f98070e00 x1875400816870400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521682.175125:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875400816870400:0@lo:400: 00000100:00100000:1.0:1788521682.177438:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875400816870528:0@lo:400: 00000100:00100000:1.0:1788521682.177503:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521682.177539:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788521682.177546:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816870656:0@lo:400: 00000100:00100000:1.0:1788521682.177583:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521682.177676:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816870656 00000100:00100000:3.0:1788521682.177683:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816870656 00000100:00100000:3.0:1788521682.177742:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788521682.177751:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816870656:12345-0@lo:400: 00000100:00100000:3.0:1788521682.177800:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816870656:12345-0@lo:400: Request processed in 51us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521682.177806:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788521682.177846:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996f98073100 x1875400816870656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521682.177858:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816870656:0@lo:400: 00000040:00080000:3.0:1788521682.178093:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:2.0:1788521682.178165:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816870528 00000100:00100000:2.0:1788521682.178170:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816870528 00000100:00100000:2.0:1788521682.178214:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788521682.178223:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875400816870528:12345-0@lo:400: 00000100:00100000:2.0:1788521682.178266:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875400816870528:12345-0@lo:400: Request processed in 46us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521682.178272:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788521682.178304:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996f98071500 x1875400816870528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521682.178314:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875400816870528:0@lo:400: 00000100:00100000:3.0:1788521682.178367:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f8574b480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7642:1875400816870784:0@lo:901: 00000100:00100000:3.0:1788521682.178395:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521682.178425:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816870784 00000100:00100000:3.0:1788521682.178428:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816870784 00000100:00100000:3.0:1788521682.178456:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788521682.178462:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7642:x1875400816870784:12345-0@lo:901: 00000100:00100000:3.0:1788521682.178788:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7642:x1875400816870784:12345-0@lo:901: Request processed in 326us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521682.178795:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788521682.178815:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb47d3900 going to sleep for 11 seconds 00010000:00080000:3.0:1788521682.178827:0:7642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996f8574b480 x1875400816870784/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788521698 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521682.178836:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f8574b480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7642:1875400816870784:0@lo:901: 00000100:00080000:1.0:1788521682.179283:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788521682.179287:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000000:0.0:1788521682.181988:0:7625:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788521682.182034:0:7625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788521682.182059:0:7625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f80030a00/0x1b7b50db5927bb52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bb59 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.182071:0:7625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996f80030a00/0x1b7b50db5927bb52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bb59 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788521682.182126:0:7625:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788521682.182128:0:7625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788521682.182130:0:7625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788521682.182131:0:7625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788521682.182137:0:7625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788521682.182139:0:7625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788521682.182158:0:7625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788521682.182160:0:7625:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788521682.182161:0:7625:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788521682.182162:0:7625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788521682.182163:0:7625:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788521682.182167:0:7625:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788521682.182169:0:7625:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788521682.182171:0:7625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788521682.182172:0:7625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788521682.182173:0:7625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788521682.182174:0:7625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788521682.182174:0:7625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788521682.182175:0:7625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788521682.182176:0:7625:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788521682.182177:0:7625:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788521682.182178:0:7625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788521682.182178:0:7625:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788521682.182213:0:7625:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788521682.182231:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816870912:0@lo:253: 00000100:00100000:0.0:1788521682.182292:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521682.182337:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816870912 00000100:00100000:3.0:1788521682.182344:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816870912 00000100:00100000:3.0:1788521682.182391:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788521682.182399:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:7625:x1875400816870912:12345-0@lo:253: 20000000:01000000:3.0:1788521682.182421:0:5827:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788521682.182434:0:5827:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788521682.183126:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90f00480 going to sleep for 11 seconds 20000000:01000000:0.0:1788521682.235909:0:5827:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788521682.235926:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788521682.236063:0:5849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788521682.236069:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788521682.236093:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996f829d4e00/0x1b7b50db5927bb75 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521682.236111:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996f80030400/0x1b7b50db5927bac6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927babf expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521682.236120:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996f829d4e00/0x1b7b50db5927bb75 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521682.236190:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996f80030400/0x1b7b50db5927bac6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927babf expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521682.236223:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996f80030400/0x1b7b50db5927bac6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927babf expref: 14 pid: 5826 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521682.236237:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1875400816871040:0@lo:104: 00000100:00100000:1.0:1788521682.236844:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521682.236901:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f91c7aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521682.236911:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816871040 00000100:00100000:3.0:1788521682.236920:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816871040 00000100:00100000:3.0:1788521682.236964:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788521682.236984:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98071c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+3:5849:x1875400816871040:12345-0@lo:104: 00010000:00010000:3.0:1788521682.236996:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996f829d4400/0x1b7b50db5927babf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bac6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521682.237055:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788521682.237060:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98071c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+3:5849:x1875400816871040:12345-0@lo:104: Request processed in 79us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521682.237067:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788521682.237129:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521682.237136:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f829d4400/0x1b7b50db5927babf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bac6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.237167:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d4400 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:0.0:1788521682.237171:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f829d4400/0x1b7b50db5927babf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927bac6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.237179:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f829d4400/0x1b7b50db5927babf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927bac6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521682.237186:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f829d4400/0x1b7b50db5927babf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927bac6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521682.237197:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521682.237246:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f829d4400/0x1b7b50db5927babf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bac6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.237253:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788521682.237261:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1875400816871040:0@lo:104: 00010000:00010000:0.0:1788521682.237276:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f829d4400/0x1b7b50db5927babf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bac6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521682.237283:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996f829d4e00/0x1b7b50db5927bb75 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.237286:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f829d4400/0x1b7b50db5927babf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bac6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.237310:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521682.237312:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521682.237313:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521682.237325:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816871168:0@lo:103: 00000100:00100000:0.0:1788521682.237356:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521682.237411:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816871168 00000100:00100000:0.0:1788521682.237416:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816871168 00010000:00010000:0.0:1788521682.237435:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996f80030400/0x1b7b50db5927bac6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927babf expref: 15 pid: 5826 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521682.237463:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788521682.237471:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f91309050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:3306:x1875400816871168:12345-0@lo:103: 00010000:00010000:0.0:1788521682.237488:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521682.237493:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996f80030400/0x1b7b50db5927bac6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927babf expref: 15 pid: 5826 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.237507:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996f80030400/0x1b7b50db5927bac6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927babf expref: 15 pid: 5826 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.237641:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f80030400/0x1b7b50db5927bac6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927babf expref: 15 pid: 5826 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.237655:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996f829d4e00/0x1b7b50db5927bb75 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.237663:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f829d4e00/0x1b7b50db5927bb75 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788521682.237675:0:5819:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002220051s 00010000:00010000:0.0:1788521682.237680:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996f829d4e00/0x1b7b50db5927bb75 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.237688:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996f829d4e00/0x1b7b50db5927bb75 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.237694:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996f829d4e00/0x1b7b50db5927bb75 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.237701:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996f829d4e00/0x1b7b50db5927bb75 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.237706:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d4e00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521682.237710:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996f829d4e00/0x1b7b50db5927bb75 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.237717:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996f829d4e00/0x1b7b50db5927bb75 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.237738:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996f829d4e00/0x1b7b50db5927bb75 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521682.237759:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521682.237788:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f91309050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:3306:x1875400816871168:12345-0@lo:103: Request processed in 318us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521682.237797:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788521682.237811:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996f829d4e00/0x1b7b50db5927bb75 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521682.237821:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996f829d4e00/0x1b7b50db5927bb75 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521682.237835:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f829d4e00/0x1b7b50db5927bb75 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521682.237852:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816871168:0@lo:103: 00000100:00100000:0.0:1788521682.246021:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:7625:x1875400816870912:12345-0@lo:253: Request processed in 63615us (63721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521682.246034:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788521682.246324:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:7625:1875400816870912:0@lo:253: 10000000:01000000:1.0:1788521682.246338:0:7625:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788521682.246341:0:7625:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788521682.246342:0:7625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788521682.246344:0:7625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788521682.246345:0:7625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788521682.246346:0:7625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788521682.246347:0:7625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788521682.246349:0:7625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788521682.246350:0:7625:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788521682.246351:0:7625:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788521682.246352:0:7625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788521682.246353:0:7625:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788521682.246367:0:7625:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788521682.251355:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788521682.251580:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788521682.251778:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788521682.251940:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788521682.252444:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788521682.252750:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788521682.254974:0:7625:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788521682.461755:0:7625:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788521682.461763:0:7625:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788521682.461796:0:7625:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788521682.461856:0:7625:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.148@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788521682.461870:0:7625:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788521682.461896:0:7625:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788521683.086290:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521683.279593:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816871296:0@lo:13: 00000100:00100000:3.0:1788521683.279794:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521683.279931:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816871296 00000100:00100000:0.0:1788521683.279939:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816871296 00000100:00100000:0.0:1788521683.279993:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521683.280004:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f8574b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816871296:12345-0@lo:13: 00002000:00000024:0.0:1788521683.280035:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521683.280085:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f8574b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816871296:12345-0@lo:13: Request processed in 84us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521683.280091:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788521683.280134:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb3f5a300 x1875400816871296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521699 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521683.280310:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816871296:0@lo:13: 00010000:00010000:2.0:1788521684.110885:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521685.138314:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521686.160826:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521687.186302:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521687.377060:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816871424:0@lo:400: 00000100:00100000:0.0:1788521687.377138:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521687.377211:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875400816871936:0@lo:400: 00000100:00100000:0.0:1788521687.377245:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521687.377282:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788521687.377289:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816871552:0@lo:400: 00000100:00100000:1.0:1788521687.377295:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875400816871680:0@lo:400: 00000100:00100000:0.0:1788521687.377316:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521687.377344:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521687.377354:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816871808:0@lo:400: 00000100:00100000:0.0:1788521687.377395:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521687.377430:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816871424 00000100:00100000:0.0:1788521687.377437:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816871424 00000100:00100000:0.0:1788521687.377475:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788521687.377484:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:3304:x1875400816871424:12345-0@lo:400: 00000100:00100000:0.0:1788521687.377525:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:3304:x1875400816871424:12345-0@lo:400: Request processed in 42us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521687.377532:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788521687.377565:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816871936 00000100:00100000:0.0:1788521687.377569:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816871936 00000100:00100000:0.0:1788521687.377595:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816871552 00000100:00100000:0.0:1788521687.377599:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816871552 00000100:00100000:0.0:1788521687.377608:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816871680 00000100:00100000:0.0:1788521687.377610:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816871680 00000100:00100000:0.0:1788521687.377623:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788521687.377630:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875400816871936:12345-0@lo:400: 00000100:00100000:0.0:1788521687.377674:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875400816871936:12345-0@lo:400: Request processed in 45us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521687.377681:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788521687.377693:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788521687.377698:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816871552:12345-0@lo:400: 00000100:00100000:0.0:1788521687.377724:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816871552:12345-0@lo:400: Request processed in 26us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521687.377730:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788521687.377748:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788521687.377753:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875400816871680:12345-0@lo:400: 00000100:00100000:0.0:1788521687.377783:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875400816871680:12345-0@lo:400: Request processed in 29us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521687.377790:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788521687.377814:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816871808 00000100:00100000:0.0:1788521687.377819:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816871808 00000100:00080000:1.0:1788521687.377845:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788521687.377852:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521687.377852:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521687.377862:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816871808:12345-0@lo:400: 00000100:00100000:0.0:1788521687.377899:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816871808:12345-0@lo:400: Request processed in 39us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521687.377906:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788521687.377944:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb3f58a80 x1875400816871808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521687.377957:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816871808:0@lo:400: 00010000:00080000:0.0:1788521687.377984:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb3f59500 x1875400816871552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521687.377993:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816871552:0@lo:400: 00000100:00100000:0.0:1788521687.378002:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816871424:0@lo:400: 00010000:00080000:0.0:1788521687.378011:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb3f5bb80 x1875400816871936/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521687.378019:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875400816871936:0@lo:400: 00010000:00080000:0.0:1788521687.378060:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb3f5ad80 x1875400816871680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521687.378081:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875400816871680:0@lo:400: 00000001:02000400:2.0:1788521687.750560:0:7985:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788521688.206449:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521688.400594:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788521688.400621:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816872064:0@lo:13: 00000100:00100000:1.0:1788521688.400688:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521688.400781:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816872064 00000100:00100000:2.0:1788521688.400789:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816872064 00000100:00100000:2.0:1788521688.400836:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788521688.400845:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98070a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816872064:12345-0@lo:13: 00002000:00000024:2.0:1788521688.400878:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521688.400923:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98070a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816872064:12345-0@lo:13: Request processed in 79us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521688.400929:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788521688.401006:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996f860d8700 x1875400816872064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521704 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521688.401027:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816872064:0@lo:13: 00010000:00010000:1.0:1788521689.234058:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521690.254302:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521691.281380:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788521691.470498:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788521691.470507:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff996f97fff000 from 30 10000000:01000000:3.0:1788521691.470512:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788521691.470569:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392d000/0x1b7b50db5927bb7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521691.470581:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996f8392d000/0x1b7b50db5927bb7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521691.470592:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f8392d000/0x1b7b50db5927bb7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521691.470617:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f8574b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816872192:0@lo:101: 00000100:00100000:3.0:1788521691.470684:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521691.470794:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90f5a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788521691.471479:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816872192 00000100:00100000:0.0:1788521691.471488:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816872192 00000100:00100000:0.0:1788521691.471636:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788521691.471646:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:5830:x1875400816872192:12345-0@lo:101: 00010000:00010000:0.0:1788521691.471659:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521691.471673:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f80030c00/0x1b7b50db5927bb83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927bb7c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521691.471697:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f80030c00/0x1b7b50db5927bb83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927bb7c expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521691.471720:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f80030c00/0x1b7b50db5927bb83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bb7c expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521691.471729:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f80030c00, rc 0) 00000100:00100000:0.0:1788521691.471786:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:5830:x1875400816872192:12345-0@lo:101: Request processed in 142us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521691.471793:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788521691.471873:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f8574b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816872192:0@lo:101: 00010000:00010000:1.0:1788521691.471888:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f8392d000/0x1b7b50db5927bb7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bb83 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521691.471898:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f8392d000/0x1b7b50db5927bb7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bb83 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521691.471968:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98072a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816872320:0@lo:501: 00000100:00100000:1.0:1788521691.471999:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521691.472432:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb483e900 going to sleep for 11 seconds 00000100:00100000:3.0:1788521691.472617:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816872320 00000100:00100000:3.0:1788521691.472623:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816872320 00000100:00100000:3.0:1788521691.472656:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788521691.472665:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:5830:x1875400816872320:12345-0@lo:501: 00000100:00100000:3.0:1788521691.474038:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:5830:x1875400816872320:12345-0@lo:501: Request processed in 1268us (1932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521691.474050:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788521691.474345:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98072a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816872320:0@lo:501: 00000100:00100000:1.0:1788521691.474466:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98072a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816872448:0@lo:503: 00000100:00100000:1.0:1788521691.474534:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521691.474645:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb483e900 going to sleep for 11 seconds 00000100:00100000:2.0:1788521691.474778:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816872448 00000100:00100000:2.0:1788521691.474786:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816872448 00000100:00100000:2.0:1788521691.474832:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788521691.474841:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:5830:x1875400816872448:12345-0@lo:503: 00000100:00100000:2.0:1788521691.475367:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:5830:x1875400816872448:12345-0@lo:503: Request processed in 527us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521691.475374:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788521691.475465:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98072a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816872448:0@lo:503: 00000100:00100000:2.0:1788521691.475868:0:8151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8151:1875400816872576:0@lo:502: 00000100:00100000:2.0:1788521691.475916:0:8151:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521691.475985:0:8151:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f8675b600 going to sleep for 11 seconds 00000100:00100000:3.0:1788521691.476020:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816872576 00000100:00100000:3.0:1788521691.476026:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816872576 00000100:00100000:3.0:1788521691.476098:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788521691.476107:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:8151:x1875400816872576:12345-0@lo:502: 00000100:00100000:3.0:1788521691.476424:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:8151:x1875400816872576:12345-0@lo:502: Request processed in 317us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521691.476432:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788521691.476571:0:8151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8151:1875400816872576:0@lo:502: 00000100:00100000:2.0:1788521691.476617:0:8151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8151:1875400816872704:0@lo:502: 00000100:00100000:2.0:1788521691.476665:0:8151:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521691.476844:0:8151:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f8675b600 going to sleep for 11 seconds 00000100:00100000:0.0:1788521691.476882:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816872704 00000100:00100000:0.0:1788521691.476886:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816872704 00000100:00100000:3.0:1788521691.476932:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788521691.476941:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:8151:x1875400816872704:12345-0@lo:502: 00000100:00100000:3.0:1788521691.477094:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:8151:x1875400816872704:12345-0@lo:502: Request processed in 154us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521691.477100:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788521691.477227:0:8151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8151:1875400816872704:0@lo:502: 00000040:00080000:2.0:1788521691.477250:0:8151:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788521691.477442:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788521691.477470:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788521691.477480:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392d000/0x1b7b50db5927bb7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bb83 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521691.477489:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996f8392d000/0x1b7b50db5927bb7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bb83 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521691.477499:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788521691.477502:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788521691.477504:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788521691.477530:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f829d5400/0x1b7b50db5927bb8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521691.477538:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996f829d5400/0x1b7b50db5927bb8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521691.477546:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f829d5400/0x1b7b50db5927bb8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521691.477561:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98072a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816872832:0@lo:101: 00000100:00100000:1.0:1788521691.477592:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521691.477621:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb483e900 going to sleep for 11 seconds 00000100:00100000:2.0:1788521691.477675:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816872832 00000100:00100000:2.0:1788521691.477685:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816872832 00000100:00100000:2.0:1788521691.477708:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788521691.477714:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:5830:x1875400816872832:12345-0@lo:101: 00010000:00010000:2.0:1788521691.477723:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521691.477736:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f8149c200/0x1b7b50db5927bb91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927bb8a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521691.477756:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8149c200/0x1b7b50db5927bb91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927bb8a expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521691.477767:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f8149c200/0x1b7b50db5927bb91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bb8a expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521691.477775:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8149c200, rc 0) 00000100:00100000:2.0:1788521691.477885:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:5830:x1875400816872832:12345-0@lo:101: Request processed in 170us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521691.477891:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788521691.477939:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98072a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816872832:0@lo:101: 00010000:00010000:1.0:1788521691.477951:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f829d5400/0x1b7b50db5927bb8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bb91 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521691.477960:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f829d5400/0x1b7b50db5927bb8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bb91 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521691.477999:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98072a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816872960:0@lo:501: 00000100:00100000:1.0:1788521691.478028:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521691.478048:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb483e900 going to sleep for 11 seconds 00000100:00100000:2.0:1788521691.478090:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816872960 00000100:00100000:2.0:1788521691.478094:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816872960 00000100:00100000:2.0:1788521691.478109:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788521691.478114:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:5830:x1875400816872960:12345-0@lo:501: 00000100:00100000:2.0:1788521691.478360:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:5830:x1875400816872960:12345-0@lo:501: Request processed in 245us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521691.478367:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788521691.478498:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98072a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816872960:0@lo:501: 00000100:00100000:1.0:1788521691.478524:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98072a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816873088:0@lo:503: 00000100:00100000:1.0:1788521691.478559:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521691.478586:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb483e900 going to sleep for 11 seconds 00000100:00100000:2.0:1788521691.478735:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816873088 00000100:00100000:2.0:1788521691.478739:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816873088 00000100:00100000:2.0:1788521691.478758:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788521691.478764:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:5830:x1875400816873088:12345-0@lo:503: 00000100:00100000:2.0:1788521691.479101:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:5830:x1875400816873088:12345-0@lo:503: Request processed in 337us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521691.479114:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788521691.479343:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98072a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816873088:0@lo:503: 00000100:00100000:2.0:1788521691.479778:0:8152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8152:1875400816873216:0@lo:502: 00000100:00100000:2.0:1788521691.479818:0:8152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521691.479891:0:8152:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb7907a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521691.480108:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816873216 00000100:00100000:0.0:1788521691.480114:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816873216 00000100:00100000:0.0:1788521691.480376:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788521691.480386:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:8152:x1875400816873216:12345-0@lo:502: 00000100:00100000:0.0:1788521691.480602:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:8152:x1875400816873216:12345-0@lo:502: Request processed in 217us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521691.480615:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788521691.480700:0:8152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8152:1875400816873216:0@lo:502: 00000020:01000000:3.0:1788521691.480729:0:8152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521691.480739:0:8152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521691.480741:0:8152:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788521691.480749:0:8152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788521691.480751:0:8152:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788521691.480770:0:8152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f8574b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8152:1875400816873344:0@lo:502: 00000100:00100000:3.0:1788521691.480806:0:8152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521691.480961:0:8152:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90f5ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788521691.481040:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816873344 00000100:00100000:2.0:1788521691.481045:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816873344 00000100:00100000:2.0:1788521691.481067:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788521691.481073:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:8152:x1875400816873344:12345-0@lo:502: 00000100:00100000:2.0:1788521691.481242:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:8152:x1875400816873344:12345-0@lo:502: Request processed in 169us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521691.481249:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788521691.481371:0:8152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f8574b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8152:1875400816873344:0@lo:502: 00000020:01000000:3.0:1788521691.481392:0:8152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521691.481400:0:8152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521691.481402:0:8152:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788521691.481407:0:8152:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788521691.481549:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788521691.481567:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788521691.481577:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f829d5400/0x1b7b50db5927bb8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bb91 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521691.481586:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996f829d5400/0x1b7b50db5927bb8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bb91 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521691.481595:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788521691.481598:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff996f85616000 from 30 10000000:01000000:2.0:1788521691.481601:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788521691.481625:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8149d800/0x1b7b50db5927bb98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521691.481633:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996f8149d800/0x1b7b50db5927bb98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521691.481704:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f8149d800/0x1b7b50db5927bb98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521691.481721:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816873472:0@lo:101: 00000100:00100000:2.0:1788521691.481751:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521691.481815:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb7907240 going to sleep for 11 seconds 00000100:00100000:0.0:1788521691.481869:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816873472 00000100:00100000:0.0:1788521691.481873:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816873472 00000100:00100000:1.0:1788521691.481935:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788521691.481944:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:5830:x1875400816873472:12345-0@lo:101: 00010000:00010000:1.0:1788521691.481954:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521691.481966:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f829d5000/0x1b7b50db5927bb9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927bb98 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521691.481987:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f829d5000/0x1b7b50db5927bb9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927bb98 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521691.481996:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f829d5000/0x1b7b50db5927bb9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bb98 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521691.482004:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f829d5000, rc 0) 00000100:00100000:1.0:1788521691.482043:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:5830:x1875400816873472:12345-0@lo:101: Request processed in 101us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521691.482049:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788521691.482101:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816873472:0@lo:101: 00010000:00010000:2.0:1788521691.482113:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f8149d800/0x1b7b50db5927bb98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bb9f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521691.482122:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f8149d800/0x1b7b50db5927bb98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bb9f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521691.482204:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816873600:0@lo:501: 00000100:00100000:2.0:1788521691.482229:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521691.482456:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb7907240 going to sleep for 11 seconds 00000100:00100000:3.0:1788521691.482486:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816873600 00000100:00100000:3.0:1788521691.482490:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816873600 00000100:00100000:3.0:1788521691.482512:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788521691.482519:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:5830:x1875400816873600:12345-0@lo:501: 00000100:00100000:3.0:1788521691.482749:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:5830:x1875400816873600:12345-0@lo:501: Request processed in 229us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521691.482756:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788521691.482958:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816873600:0@lo:501: 00000100:00100000:2.0:1788521691.482988:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816873728:0@lo:503: 00000100:00100000:2.0:1788521691.483027:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521691.483051:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb7907240 going to sleep for 11 seconds 00000100:00100000:3.0:1788521691.483095:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816873728 00000100:00100000:3.0:1788521691.483100:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816873728 00000100:00100000:3.0:1788521691.483118:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788521691.483124:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:5830:x1875400816873728:12345-0@lo:503: 00000100:00100000:3.0:1788521691.483463:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:5830:x1875400816873728:12345-0@lo:503: Request processed in 338us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521691.483471:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788521691.483593:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816873728:0@lo:503: 00000100:00100000:0.0:1788521691.483992:0:8153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82a60a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8153:1875400816873856:0@lo:502: 00000100:00100000:0.0:1788521691.484031:0:8153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521691.484093:0:8153:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fbc3d6840 going to sleep for 11 seconds 00000100:00100000:3.0:1788521691.484135:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816873856 00000100:00100000:3.0:1788521691.484428:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816873856 00000100:00100000:3.0:1788521691.484503:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788521691.484511:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:8153:x1875400816873856:12345-0@lo:502: 00000100:00100000:3.0:1788521691.484830:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:8153:x1875400816873856:12345-0@lo:502: Request processed in 320us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521691.484838:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788521691.484903:0:8153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82a60a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8153:1875400816873856:0@lo:502: 00000100:00100000:1.0:1788521691.484954:0:8153:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98072a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8153:1875400816873984:0@lo:502: 00000100:00100000:1.0:1788521691.484991:0:8153:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521691.485082:0:8153:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb483ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521691.485120:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816873984 00000100:00100000:0.0:1788521691.485125:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816873984 00000100:00100000:0.0:1788521691.485256:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788521691.485265:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:8153:x1875400816873984:12345-0@lo:502: 00000100:00100000:0.0:1788521691.485421:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:8153:x1875400816873984:12345-0@lo:502: Request processed in 157us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521691.485428:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788521691.485520:0:8153:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98072a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8153:1875400816873984:0@lo:502: 00000040:00080000:1.0:1788521691.485542:0:8153:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788521691.485742:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788521691.485760:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788521691.485769:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8149d800/0x1b7b50db5927bb98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bb9f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521691.485780:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996f8149d800/0x1b7b50db5927bb98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bb9f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521691.485789:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788521691.485791:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff996f85616000 from 5 10000000:01000000:0.0:1788521691.485794:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788521691.485821:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f80030000/0x1b7b50db5927bba6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521691.485829:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996f80030000/0x1b7b50db5927bba6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521691.485845:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f80030000/0x1b7b50db5927bba6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521691.485859:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82a62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816874112:0@lo:101: 00000100:00100000:0.0:1788521691.485887:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521691.485919:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fbc3d6600 going to sleep for 11 seconds 00000100:00100000:1.0:1788521691.485971:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816874112 00000100:00100000:1.0:1788521691.485975:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816874112 00000100:00100000:1.0:1788521691.485997:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788521691.486003:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:5830:x1875400816874112:12345-0@lo:101: 00010000:00010000:1.0:1788521691.486012:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521691.486024:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f829d5c00/0x1b7b50db5927bbad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927bba6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521691.486041:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f829d5c00/0x1b7b50db5927bbad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927bba6 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521691.486051:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f829d5c00/0x1b7b50db5927bbad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bba6 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521691.486058:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f829d5c00, rc 0) 00000100:00100000:1.0:1788521691.486095:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:5830:x1875400816874112:12345-0@lo:101: Request processed in 91us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521691.486101:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788521691.486304:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82a62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816874112:0@lo:101: 00010000:00010000:0.0:1788521691.486317:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f80030000/0x1b7b50db5927bba6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bbad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521691.486325:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f80030000/0x1b7b50db5927bba6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bbad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521691.486371:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82a62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816874240:0@lo:256: 00000100:00100000:0.0:1788521691.486399:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521691.486420:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fbc3d6600 going to sleep for 11 seconds 00000100:00100000:1.0:1788521691.486482:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816874240 00000100:00100000:1.0:1788521691.486487:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816874240 00000100:00100000:1.0:1788521691.486517:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788521691.486524:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:5830:x1875400816874240:12345-0@lo:256: 20000000:01000000:1.0:1788521691.486536:0:5827:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788521691.486555:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788521691.486559:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788521691.486646:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:5830:x1875400816874240:12345-0@lo:256: Request processed in 123us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521691.486724:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788521691.486789:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82a62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816874240:0@lo:256: 10000000:01000000:0.0:1788521691.486828:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788521691.486835:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f80030000/0x1b7b50db5927bba6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bbad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521691.486843:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996f80030000/0x1b7b50db5927bba6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bbad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521691.486850:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788521691.486852:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788521691.486858:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788521691.486873:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bbb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521691.486880:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bbb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521691.486888:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bbb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521691.486897:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82a62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816874368:0@lo:101: 00000100:00100000:0.0:1788521691.486918:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521691.486939:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fbc3d6600 going to sleep for 11 seconds 00000100:00100000:2.0:1788521691.486983:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816874368 00000100:00100000:2.0:1788521691.486987:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816874368 00000100:00100000:2.0:1788521691.487008:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788521691.487014:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:5830:x1875400816874368:12345-0@lo:101: 00010000:00010000:2.0:1788521691.487025:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521691.487034:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f8149de00/0x1b7b50db5927bbbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927bbb4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521691.487049:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8149de00/0x1b7b50db5927bbbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927bbb4 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521691.487057:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f8149de00/0x1b7b50db5927bbbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bbb4 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521691.487065:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8149de00, rc 0) 00000100:00100000:2.0:1788521691.487098:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:5830:x1875400816874368:12345-0@lo:101: Request processed in 84us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521691.487104:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788521691.487285:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82a62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816874368:0@lo:101: 00010000:00010000:0.0:1788521691.487296:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bbb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bbbb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521691.487304:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bbb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bbbb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521691.487344:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82a62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816874496:0@lo:501: 00000100:00100000:0.0:1788521691.487367:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521691.487389:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fbc3d6600 going to sleep for 11 seconds 00000100:00100000:2.0:1788521691.487456:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816874496 00000100:00100000:2.0:1788521691.487459:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816874496 00000100:00100000:2.0:1788521691.487477:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788521691.487483:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:5830:x1875400816874496:12345-0@lo:501: 00000100:00100000:2.0:1788521691.487744:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:5830:x1875400816874496:12345-0@lo:501: Request processed in 260us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521691.487750:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788521691.487851:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82a62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816874496:0@lo:501: 00000100:00100000:0.0:1788521691.487876:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82a62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816874624:0@lo:503: 00000100:00100000:0.0:1788521691.487908:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521691.487926:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fbc3d6600 going to sleep for 11 seconds 00000100:00100000:2.0:1788521691.487966:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816874624 00000100:00100000:2.0:1788521691.487969:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816874624 00000100:00100000:2.0:1788521691.488025:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788521691.488031:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:5830:x1875400816874624:12345-0@lo:503: 00000100:00100000:2.0:1788521691.488368:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:5830:x1875400816874624:12345-0@lo:503: Request processed in 336us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521691.488374:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788521691.488512:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82a62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816874624:0@lo:503: 00000100:00100000:1.0:1788521691.490664:0:8154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98072a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8154:1875400816874752:0@lo:502: 00000100:00100000:1.0:1788521691.490736:0:8154:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521691.493504:0:8154:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb483ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788521691.495950:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816874752 00000100:00100000:0.0:1788521691.495977:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816874752 00000100:00100000:2.0:1788521691.496072:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788521691.496088:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:8154:x1875400816874752:12345-0@lo:502: 00000100:00100000:2.0:1788521691.497334:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:8154:x1875400816874752:12345-0@lo:502: Request processed in 1246us (6593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521691.497343:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788521691.497856:0:8154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98072a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8154:1875400816874752:0@lo:502: 00000020:01000000:1.0:1788521691.497893:0:8154:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788521691.497900:0:8154:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788521691.497906:0:8154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521691.497909:0:8154:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788521691.497913:0:8154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788521691.497917:0:8154:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.148@tcp to nid 0x20000c0a8ce94 (192.168.206.148@tcp) 00000020:01000000:1.0:1788521691.497939:0:8154:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788521691.497942:0:8154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788521691.497956:0:8154:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff996f90f1cd40) 00000020:00000080:1.0:1788521691.497976:0:8154:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788521691.497982:0:8154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788521691.498054:0:8154:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788521691.498059:0:8154:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788521691.498066:0:8154:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b7b50db5927bbc9 00010000:00080000:1.0:1788521691.498094:0:8154:0:(ldlm_lib.c:102:import_set_conn()) imp ffff996f913e1800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.148@tcp at head 00010000:00010000:1.0:1788521691.498537:0:8154:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1788521691.499123:0:8154:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788521691.499137:0:8154:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788521691.499860:0:8154:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788521691.500092:0:8154:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788521691.500520:0:8154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788521691.500593:0:8154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788521691.501362:0:8155:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788521691.501367:0:8155:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788521691.504043:0:8154:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788521691.504056:0:8154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788521691.504086:0:8154:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788521691.504105:0:8154:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b7b50db5927bbd0 00000100:00080000:1.0:1788521691.504114:0:8154:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788521691.504119:0:8154:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff996f913e1800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1788521691.504339:0:8154:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996f98072a00 x1875400816874880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788521691.504383:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98072a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875400816874880:0@lo:8: 00000100:00100000:3.0:1788521691.504444:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521691.504525:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816874880 00000100:00100000:0.0:1788521691.504532:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816874880 00000100:00100000:0.0:1788521691.504565:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521691.504573:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f8574b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1875400816874880:12345-0@lo:8: 00010000:00080000:0.0:1788521691.504595:0:6689:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:0.0:1788521691.504617:0:6689:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b7b50db5927bbd7 00002000:00100000:0.0:1788521691.504629:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff996fbfc67800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788521691.504633:0:6689:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1788521691.504636:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788521691.504756:0:6689:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788521691.504877:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788521691.504901:0:6689:0:(import.c:65:import_set_state_nolock()) ffff996fbfc66000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788521691.505451:0:8154:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788521691.505524:0:8154:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788521691.505529:0:8154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521691.505531:0:8154:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788521691.505535:0:8154:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788521691.505539:0:8154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521691.505540:0:8154:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788521691.505543:0:8154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788521691.505544:0:8154:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788521691.505572:0:8154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8154:1875400816875008:0@lo:502: 00000100:00100000:1.0:1788521691.505635:0:8154:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521691.505681:0:8154:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb483e300 going to sleep for 11 seconds 00000100:00100000:1.0:1788521691.507005:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875400816875136:0@lo:400: 00000100:00100000:1.0:1788521691.507068:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521691.507113:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788521691.507119:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875400816875264:0@lo:400: 00000100:00100000:2.0:1788521691.507284:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816875136 00000100:00100000:2.0:1788521691.507293:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816875136 00000100:00100000:2.0:1788521691.507339:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788521691.507349:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875400816875136:12345-0@lo:400: 00000100:00100000:2.0:1788521691.507397:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875400816875136:12345-0@lo:400: Request processed in 50us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521691.507403:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788521691.507450:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788521691.507494:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996f860db100 x1875400816875136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521691.507506:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875400816875136:0@lo:400: 00000100:00100000:1.0:1788521691.507547:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816875392:0@lo:400: 00000100:00100000:1.0:1788521691.507576:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521691.507598:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788521691.507604:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875400816875520:0@lo:400: 00000100:00100000:1.0:1788521691.507630:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521691.507673:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816875264 00000100:00100000:1.0:1788521691.507677:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816875264 00000100:00100000:1.0:1788521691.507702:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816875520 00000100:00100000:1.0:1788521691.507706:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816875520 00000100:00100000:1.0:1788521691.507725:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788521691.507731:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875400816875264:12345-0@lo:400: 00000100:00100000:1.0:1788521691.507766:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875400816875264:12345-0@lo:400: Request processed in 34us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521691.507773:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788521691.507786:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788521691.507792:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875400816875520:12345-0@lo:400: 00000100:00100000:1.0:1788521691.507822:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875400816875520:12345-0@lo:400: Request processed in 31us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521691.507828:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788521691.507842:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788521691.507859:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996f860da300 x1875400816875520/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521691.507869:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875400816875520:0@lo:400: 00010000:00080000:1.0:1788521691.507891:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996f860dbb80 x1875400816875264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521691.507899:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875400816875264:0@lo:400: 00000100:00100000:0.0:1788521691.508401:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f8574b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1875400816874880:12345-0@lo:8: Request processed in 3825us (3954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521691.508410:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521691.508427:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816875392 00000100:00100000:0.0:1788521691.508431:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816875392 00000100:00100000:0.0:1788521691.508503:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521691.508510:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816875392:12345-0@lo:400: 00000100:00100000:0.0:1788521691.508552:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816875392:12345-0@lo:400: Request processed in 42us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521691.508558:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788521691.508597:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996f860d8000 x1875400816875392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521691.508608:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816875392:0@lo:400: 00000100:00100000:0.0:1788521691.508627:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816875008 00000100:00100000:0.0:1788521691.508638:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816875008 00000100:00100000:0.0:1788521691.508672:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788521691.508679:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:8154:x1875400816875008:12345-0@lo:502: 00000100:00100000:0.0:1788521691.508906:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:8154:x1875400816875008:12345-0@lo:502: Request processed in 228us (3271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521691.508913:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:3.0:1788521691.509945:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996f98072a00 x1875400816874880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788521701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521691.509975:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788521691.509984:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788521691.509993:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788521691.510000:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788521691.510003:0:3303:0:(import.c:65:import_set_state_nolock()) ffff996f913e1800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788521691.510069:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788521691.510076:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98072a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875400816874880:0@lo:8: 00000004:00080000:0.0:1788521691.510328:0:8155:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788521691.510470:0:8155:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 191495326753ns, next at 0ns, rc = 0 00000100:00080000:1.0:1788521691.511930:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521691.512248:0:8154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8154:1875400816875008:0@lo:502: 00000020:01000000:1.0:1788521691.512286:0:8154:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788521691.512293:0:8154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521691.512295:0:8154:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788521691.512299:0:8154:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1788521691.512452:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788521691.512472:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788521691.512482:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bbb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bbbb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521691.512493:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bbb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bbbb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521691.512503:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788521691.512506:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff996f8606b380 from 1 10000000:01000000:0.0:1788521691.512509:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788521691.512540:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f80030600/0x1b7b50db5927bbde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521691.512549:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996f80030600/0x1b7b50db5927bbde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521691.512558:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f80030600/0x1b7b50db5927bbde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521691.512576:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82a63b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816875648:0@lo:101: 00000100:00100000:0.0:1788521691.512632:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521691.512688:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fbc3d6840 going to sleep for 11 seconds 00000100:00100000:1.0:1788521691.513766:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816875648 00000100:00100000:1.0:1788521691.513776:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816875648 00000100:00100000:1.0:1788521691.513824:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788521691.513832:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:5830:x1875400816875648:12345-0@lo:101: 00010000:00010000:1.0:1788521691.513848:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521691.513945:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f829d5600/0x1b7b50db5927bbe5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927bbde expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521691.513975:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f829d5600/0x1b7b50db5927bbe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927bbde expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521691.513988:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f829d5600/0x1b7b50db5927bbe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bbde expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521691.513997:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f829d5600, rc 0) 00000100:00100000:1.0:1788521691.514058:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:5830:x1875400816875648:12345-0@lo:101: Request processed in 226us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521691.514065:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788521691.514124:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82a63b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816875648:0@lo:101: 00010000:00010000:1.0:1788521691.514138:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f80030600/0x1b7b50db5927bbde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bbe5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521691.514173:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f80030600/0x1b7b50db5927bbde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bbe5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521691.515381:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816875776:0@lo:501: 00000100:00100000:1.0:1788521691.515435:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521691.515470:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb483e300 going to sleep for 11 seconds 00000100:00100000:1.0:1788521691.515491:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816875776 00000100:00100000:1.0:1788521691.515497:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816875776 00000100:00100000:1.0:1788521691.515531:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788521691.515538:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:5830:x1875400816875776:12345-0@lo:501: 00000100:00100000:1.0:1788521691.515716:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:5830:x1875400816875776:12345-0@lo:501: Request processed in 177us (280us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788521691.515724:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788521691.515765:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816875776:0@lo:501: 10000000:01000000:1.0:1788521691.515789:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788521691.515796:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f80030600/0x1b7b50db5927bbde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bbe5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521691.515805:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996f80030600/0x1b7b50db5927bbde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bbe5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788521691.552929:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788521691.635094:0:8156:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788521691.635126:0:8156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85748e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8156:1875400816876032:0@lo:7: 00000100:00100000:3.0:1788521691.635235:0:8156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521691.635286:0:8156:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90f5acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521691.635304:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816876032 00000100:00100000:3.0:1788521691.635310:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816876032 00000100:00100000:3.0:1788521691.635365:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788521691.635374:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8156:x1875400816876032:12345-0@lo:7: 00000100:00100000:2.0:1788521691.635827:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788521691.635839:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f8574aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816875904:0@lo:13: 00000100:00100000:2.0:1788521691.635889:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521691.635918:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816875904 00000100:00100000:2.0:1788521691.635922:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816875904 00000100:00100000:2.0:1788521691.635950:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788521691.635957:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875400816875904:12345-0@lo:13: 00002000:00000024:2.0:1788521691.635978:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788521691.636018:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875400816875904:12345-0@lo:13: Request processed in 62us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521691.636025:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788521691.636065:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996f8574aa00 x1875400816875904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521707 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521691.636091:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f8574aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816875904:0@lo:13: 00000100:00080000:2.0:1788521691.638420:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1788521691.657411:0:6689:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788521691.657420:0:6689:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788521691.659413:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8156:x1875400816876032:12345-0@lo:7: Request processed in 24032us (24169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521691.659426:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788521691.659623:0:8156:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996f85748e00 x1875400816876032/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788521707 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521691.659639:0:8156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85748e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8156:1875400816876032:0@lo:7: 00000004:00080000:0.0:1788521691.659653:0:8156:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788521691.659690:0:8156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82a61c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8156:1875400816876160:0@lo:5: 00000100:00100000:0.0:1788521691.659727:0:8156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521691.659822:0:8156:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f8675ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521691.659862:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816876160 00000100:00100000:1.0:1788521691.659869:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816876160 00000100:00100000:1.0:1788521691.659912:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788521691.659921:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8156:x1875400816876160:12345-0@lo:5: 00002000:00080000:1.0:1788521691.659945:0:6690:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788521691.659948:0:6690:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788521691.660524:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8156:x1875400816876160:12345-0@lo:5: Request processed in 603us (795us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788521691.660546:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788521691.660815:0:8156:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996e82a61c00 x1875400816876160/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788521707 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521691.660830:0:8156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82a61c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8156:1875400816876160:0@lo:5: 00000004:00080000:3.0:1788521691.660841:0:8156:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788521691.660871:0:8156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85748380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8156:1875400816876288:0@lo:700: 00000100:00100000:3.0:1788521691.660912:0:8156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521691.660991:0:8156:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90f5a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788521691.666241:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816876288 00000100:00100000:0.0:1788521691.666257:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816876288 00000100:00100000:0.0:1788521691.666310:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788521691.666319:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f8574bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8156:x1875400816876288:12345-0@lo:700: 00000100:00100000:0.0:1788521691.666374:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82a61180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6696:1875400816876416:0@lo:700: 00000100:00100000:0.0:1788521691.666447:0:6696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521691.666481:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f8675ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521691.666919:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816876416 00000100:00100000:2.0:1788521691.666924:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816876416 00000100:00100000:2.0:1788521691.666963:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788521691.666970:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6696:x1875400816876416:12345-0@lo:700: 40000000:02000000:2.0:1788521691.742559:0:5840:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1788521691.754423:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6696:x1875400816876416:12345-0@lo:700: Request processed in 87445us (87981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521691.754438:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788521691.754615:0:6696:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996e82a61180 x1875400816876416/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788521707 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521691.754632:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82a61180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6696:1875400816876416:0@lo:700: 40000000:02000000:1.0:1788521691.754646:0:6696:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:2.0:1788521691.811174:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f8574bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8156:x1875400816876288:12345-0@lo:700: Request processed in 144819us (150225us total) trans 0 rc 0/0 00010000:00080000:3.0:1788521691.811353:0:8156:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996f85748380 x1875400816876288/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788521707 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521691.811371:0:8156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85748380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8156:1875400816876288:0@lo:700: 00000100:00100000:2.0:1788521691.811669:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00100000:1.0:1788521691.817501:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788521691.817527:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000004:02000040:3.0:1788521691.852975:0:8156:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1788521691.857368:0:8156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85748380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8156:1875400816876544:0@lo:5: 00000100:00100000:3.0:1788521691.857440:0:8156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521691.857558:0:8156:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f88783cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521691.857710:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816876544 00000100:00100000:0.0:1788521691.857718:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816876544 00000100:00100000:0.0:1788521691.857808:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788521691.857819:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85748e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8156:x1875400816876544:12345-0@lo:5: 00002000:00080000:3.0:1788521691.864474:0:6687:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788521691.864566:0:6687:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788521691.869087:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85748e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8156:x1875400816876544:12345-0@lo:5: Request processed in 11265us (11641us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788521691.869099:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788521691.869423:0:8156:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996f85748380 x1875400816876544/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788521707 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521691.869436:0:8156:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788521691.869450:0:8156:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff996f85748380 x1875400816876544/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788521707 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521691.869460:0:8156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85748380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8156:1875400816876544:0@lo:5: 00000004:00080000:0.0:1788521691.869471:0:8156:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1788521692.303377:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788521692.336580:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1788521692.912824:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521692.913188:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799027328 00000100:00100000:2.0:1788521692.913198:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799027328 00000100:00100000:2.0:1788521692.913245:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 111 00000100:00100000:2.0:1788521692.913254:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2360:x1875400799027328:12345-192.168.206.48@tcp:250: 00010000:00080000:2.0:1788521692.913283:0:5827:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from b8401310-f5ba-4cf2-b118-0866831b1010@192.168.206.48@tcp t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:2.0:1788521692.913312:0:5827:0:(genops.c:1385:class_connect()) connect: client b8401310-f5ba-4cf2-b118-0866831b1010, cookie 0x1b7b50db5927bbec 00000100:00080000:2.0:1788521692.913443:0:5827:0:(import.c:65:import_set_state_nolock()) ffff996fbfc53000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788521692.913507:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+5:2360:x1875400799027328:12345-192.168.206.48@tcp:250: Request processed in 252us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521692.913515:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 111 00000100:00100000:1.0:1788521692.928245:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521692.928289:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799027456 00000100:00100000:1.0:1788521692.928298:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799027456 00000100:00100000:1.0:1788521692.928343:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 112 00000100:00100000:1.0:1788521692.928353:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+5:5586:x1875400799027456:12345-192.168.206.48@tcp:101: 00010000:00010000:1.0:1788521692.928369:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521692.928384:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f829d4400/0x1b7b50db5927bbf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00843 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521692.928411:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f829d4400/0x1b7b50db5927bbf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00843 expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521692.928424:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f829d4400/0x1b7b50db5927bbf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00843 expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521692.928433:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f829d4400, rc 0) 00000100:00100000:1.0:1788521692.929137:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+6:5586:x1875400799027456:12345-192.168.206.48@tcp:101: Request processed in 782us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521692.929193:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 112 00000100:00100000:3.0:1788521692.938346:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521692.938404:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799027584 00000100:00100000:0.0:1788521692.938414:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799027584 00000100:00100000:0.0:1788521692.938463:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 113 00000100:00100000:0.0:1788521692.938474:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+6:5586:x1875400799027584:12345-192.168.206.48@tcp:501: 00000100:00100000:0.0:1788521692.938967:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+6:5586:x1875400799027584:12345-192.168.206.48@tcp:501: Request processed in 493us (628us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788521692.938976:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 113 00000100:00100000:1.0:1788521692.946890:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521692.948109:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799027712 00000100:00100000:2.0:1788521692.948121:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799027712 00000100:00100000:2.0:1788521692.948214:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 114 00000100:00100000:2.0:1788521692.948224:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+6:5586:x1875400799027712:12345-192.168.206.48@tcp:101: 00010000:00010000:2.0:1788521692.948239:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521692.948255:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f8149c600/0x1b7b50db5927bbfa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe705d7355cd0084a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521692.948280:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8149c600/0x1b7b50db5927bbfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0084a expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521692.948291:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f8149c600/0x1b7b50db5927bbfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0084a expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521692.948300:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8149c600, rc 0) 00000100:00100000:2.0:1788521692.948383:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+7:5586:x1875400799027712:12345-192.168.206.48@tcp:101: Request processed in 160us (1501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521692.948390:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 114 00000100:00100000:0.0:1788521692.954955:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521692.954993:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799027840 00000100:00100000:0.0:1788521692.955005:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799027840 00000100:00100000:0.0:1788521692.955053:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 115 00000100:00100000:0.0:1788521692.955063:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+7:5586:x1875400799027840:12345-192.168.206.48@tcp:501: 00000100:00100000:0.0:1788521692.955588:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+8:5586:x1875400799027840:12345-192.168.206.48@tcp:501: Request processed in 525us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521692.955597:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 115 00000100:00100000:3.0:1788521692.959632:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521692.959702:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799027968 00000100:00100000:1.0:1788521692.959712:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799027968 00000100:00100000:1.0:1788521692.960333:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 116 00000100:00100000:1.0:1788521692.960344:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+8:5586:x1875400799027968:12345-192.168.206.48@tcp:503: 00000100:00100000:1.0:1788521692.960674:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+8:5586:x1875400799027968:12345-192.168.206.48@tcp:503: Request processed in 332us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521692.960682:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 116 00000100:00100000:0.0:1788521692.976199:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521692.976264:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799028096 00000100:00100000:2.0:1788521692.976273:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799028096 00000100:00100000:2.0:1788521692.976323:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 117 00000100:00100000:2.0:1788521692.976332:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+8:5604:x1875400799028096:12345-192.168.206.48@tcp:502: 00000100:00100000:2.0:1788521692.976634:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+8:5604:x1875400799028096:12345-192.168.206.48@tcp:502: Request processed in 301us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521692.976642:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 117 00000100:00100000:0.0:1788521692.997129:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521692.997287:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799028224 00000100:00100000:1.0:1788521692.997297:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799028224 00000100:00100000:1.0:1788521692.997336:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 118 00000100:00100000:1.0:1788521693.001482:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+8:5604:x1875400799028224:12345-192.168.206.48@tcp:502: 00000100:00100000:1.0:1788521693.002059:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+8:5604:x1875400799028224:12345-192.168.206.48@tcp:502: Request processed in 4713us (4937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521693.003250:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 118 00000100:00100000:3.0:1788521693.007821:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521693.007937:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799028352 00000100:00100000:2.0:1788521693.007947:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799028352 00000100:00100000:2.0:1788521693.008064:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 119 00000100:00100000:2.0:1788521693.008074:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+8:5586:x1875400799028352:12345-192.168.206.48@tcp:101: 00010000:00010000:2.0:1788521693.008101:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521693.008117:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f8149d200/0x1b7b50db5927bc01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00874 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521693.008174:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8149d200/0x1b7b50db5927bc01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00874 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521693.008187:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f8149d200/0x1b7b50db5927bc01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00874 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521693.008197:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8149d200, rc 0) 00000100:00100000:2.0:1788521693.008247:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+9:5586:x1875400799028352:12345-192.168.206.48@tcp:101: Request processed in 174us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521693.008253:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 119 00000100:00100000:3.0:1788521693.015828:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521693.016018:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799028480 00000100:00100000:1.0:1788521693.016028:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799028480 00000100:00100000:2.0:1788521693.016350:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 120 00000100:00100000:2.0:1788521693.016362:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+9:5586:x1875400799028480:12345-192.168.206.48@tcp:256: 20000000:01000000:2.0:1788521693.016393:0:5827:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788521693.016416:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788521693.016420:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788521693.016423:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788521693.016426:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788521693.019661:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+9:5586:x1875400799028480:12345-192.168.206.48@tcp:256: Request processed in 3294us (3834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521693.019675:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 120 00000100:00100000:3.0:1788521693.027990:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521693.029835:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799028608 00000100:00100000:2.0:1788521693.029845:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799028608 00000100:00100000:2.0:1788521693.029913:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 121 00000100:00100000:2.0:1788521693.029925:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+9:5586:x1875400799028608:12345-192.168.206.48@tcp:101: 00010000:00010000:2.0:1788521693.029951:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521693.029969:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f8149c400/0x1b7b50db5927bc08 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe705d7355cd0087b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521693.029999:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8149c400/0x1b7b50db5927bc08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0087b expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521693.030012:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f8149c400/0x1b7b50db5927bc08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0087b expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521693.030022:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8149c400, rc 0) 00000100:00100000:2.0:1788521693.030341:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+10:5586:x1875400799028608:12345-192.168.206.48@tcp:101: Request processed in 416us (2360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521693.030349:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 121 00000100:00100000:1.0:1788521693.047519:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521693.047574:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799028736 00000100:00100000:2.0:1788521693.047656:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799028736 00000100:00100000:2.0:1788521693.047804:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 122 00000100:00100000:2.0:1788521693.047817:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+10:5586:x1875400799028736:12345-192.168.206.48@tcp:501: 00000100:00100000:2.0:1788521693.048103:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+10:5586:x1875400799028736:12345-192.168.206.48@tcp:501: Request processed in 288us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521693.048111:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 122 00000100:00100000:3.0:1788521693.051008:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521693.051043:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799028864 00000100:00100000:3.0:1788521693.051052:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799028864 00000100:00100000:3.0:1788521693.051100:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 123 00000100:00100000:3.0:1788521693.051108:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+10:5586:x1875400799028864:12345-192.168.206.48@tcp:503: 00000100:00100000:3.0:1788521693.052808:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+10:5586:x1875400799028864:12345-192.168.206.48@tcp:503: Request processed in 1693us (1800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521693.052829:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 123 00000100:00100000:0.0:1788521693.062680:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521693.062794:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799028992 00000100:00100000:2.0:1788521693.062804:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799028992 00000100:00100000:2.0:1788521693.062859:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 124 00000100:00100000:2.0:1788521693.062869:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+10:5608:x1875400799028992:12345-192.168.206.48@tcp:502: 00000100:00100000:2.0:1788521693.063485:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+10:5608:x1875400799028992:12345-192.168.206.48@tcp:502: Request processed in 615us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521693.063505:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 124 00000100:00100000:0.0:1788521693.071858:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521693.074693:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799029120 00000100:00100000:3.0:1788521693.074705:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799029120 00000100:00100000:3.0:1788521693.074762:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 125 00000100:00100000:3.0:1788521693.074773:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+10:5608:x1875400799029120:12345-192.168.206.48@tcp:502: 00000100:00100000:2.0:1788521693.076742:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+10:5608:x1875400799029120:12345-192.168.206.48@tcp:502: Request processed in 1961us (4883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521693.076756:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 125 00000100:00100000:2.0:1788521693.088328:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521693.088937:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799029248 00000100:00100000:1.0:1788521693.088948:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799029248 00000100:00100000:1.0:1788521693.089001:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:1.0:1788521693.089010:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2360:x1875400799029248:12345-192.168.206.48@tcp:38: 00010000:00080000:1.0:1788521693.089041:0:5834:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 4bd13e8f-aac9-42ad-8625-a542705d6920@192.168.206.48@tcp t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:1.0:1788521693.089090:0:5834:0:(genops.c:1385:class_connect()) connect: client 4bd13e8f-aac9-42ad-8625-a542705d6920, cookie 0x1b7b50db5927bc0f 00000004:00100000:1.0:1788521693.089117:0:5834:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788521693.089135:0:5834:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1788521693.134722:0:5834:0:(import.c:65:import_set_state_nolock()) ffff996fb47cc000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788521693.134804:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2360:x1875400799029248:12345-192.168.206.48@tcp:38: Request processed in 45792us (46483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521693.134815:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 4 00010000:00010000:0.0:1788521693.326676:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521693.518660:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788521693.518844:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816876672:0@lo:13: 00000100:00100000:1.0:1788521693.518916:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521693.518959:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816876672 00000100:00100000:2.0:1788521693.518967:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816876672 00000100:00100000:2.0:1788521693.519026:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788521693.519033:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816876672:12345-0@lo:13: 00002000:00000024:2.0:1788521693.519060:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521693.519101:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816876672:12345-0@lo:13: Request processed in 69us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521693.519105:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788521693.519186:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788521693.519196:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996f860dbb80 x1875400816876672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521709 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521693.519228:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816876672:0@lo:13: 00000100:00100000:0.0:1788521694.147464:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521694.147514:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521694.148316:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799029504 00000100:00100000:2.0:1788521694.148328:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799029504 00000100:00100000:2.0:1788521694.148399:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799029376 00000100:00100000:2.0:1788521694.148403:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799029376 00000100:00100000:2.0:1788521694.148423:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:2.0:1788521694.148433:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+7:5586:x1875400799029504:12345-192.168.206.48@tcp:41: 00000004:00000024:2.0:1788521694.148539:0:5835:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788521694.148603:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+7:5586:x1875400799029504:12345-192.168.206.48@tcp:41: Request processed in 171us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521694.148611:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:2.0:1788521694.148628:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:2.0:1788521694.148635:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+6:0:x1875400799029376:12345-192.168.206.48@tcp:41: 00000004:00000024:2.0:1788521694.148645:0:5835:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00080000:3.0:1788521694.148752:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521694.148990:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+6:0:x1875400799029376:12345-192.168.206.48@tcp:41: Request processed in 354us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521694.148997:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:3.0:1788521694.150609:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521694.150869:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799029632 00000100:00100000:0.0:1788521694.150879:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799029632 00000100:00100000:0.0:1788521694.150925:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:0.0:1788521694.150945:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f8574aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+6:5586:x1875400799029632:12345-192.168.206.48@tcp:40: 00000100:00100000:0.0:1788521694.151019:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f8574aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+6:5586:x1875400799029632:12345-192.168.206.48@tcp:40: Request processed in 76us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521694.151026:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:3.0:1788521694.154964:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521694.155014:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521694.155050:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799030016 00000100:00100000:1.0:1788521694.155060:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799030016 00000100:00100000:2.0:1788521694.155110:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799030144 00000100:00100000:2.0:1788521694.155116:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799030144 00000100:00100000:1.0:1788521694.155117:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:1.0:1788521694.155184:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f8574b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+6:5586:x1875400799030016:12345-192.168.206.48@tcp:33: 00000100:00100000:2.0:1788521694.155193:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 126 00000100:00100000:2.0:1788521694.155202:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+10:2364:x1875400799030144:12345-192.168.206.48@tcp:400: 00000100:00100000:2.0:1788521694.155258:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+10:2364:x1875400799030144:12345-192.168.206.48@tcp:400: Request processed in 56us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521694.155265:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 126 00000100:00100000:0.0:1788521694.155843:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521694.155920:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521694.156032:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799029760 00000100:00100000:2.0:1788521694.156037:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799029760 00000100:00100000:2.0:1788521694.156067:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799029888 00000100:00100000:2.0:1788521694.156070:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799029888 00000100:00100000:2.0:1788521694.156082:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:2.0:1788521694.156087:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1875400799029760:12345-192.168.206.48@tcp:8: 00010000:00080000:2.0:1788521694.156110:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4bd13e8f-aac9-42ad-8625-a542705d6920@192.168.206.48@tcp t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:2.0:1788521694.156940:0:6690:0:(genops.c:1385:class_connect()) connect: client 4bd13e8f-aac9-42ad-8625-a542705d6920, cookie 0x1b7b50db5927bc16 00002000:00100000:2.0:1788521694.156953:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4bd13e8f-aac9-42ad-8625-a542705d6920/ffff996f87caa800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788521694.156964:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788521694.157513:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788521694.157545:0:6690:0:(import.c:65:import_set_state_nolock()) ffff996f87cac800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788521694.157626:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2360:x1875400799029760:12345-192.168.206.48@tcp:8: Request processed in 1535us (1783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521694.157644:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:2.0:1788521694.157665:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:2.0:1788521694.157682:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1875400799029888:12345-192.168.206.48@tcp:8: 00010000:00080000:2.0:1788521694.157705:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4bd13e8f-aac9-42ad-8625-a542705d6920@192.168.206.48@tcp t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:2.0:1788521694.157724:0:6690:0:(genops.c:1385:class_connect()) connect: client 4bd13e8f-aac9-42ad-8625-a542705d6920, cookie 0x1b7b50db5927bc1d 00002000:00100000:2.0:1788521694.157731:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4bd13e8f-aac9-42ad-8625-a542705d6920/ffff996f87cad800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788521694.157746:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788521694.157950:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788521694.157966:0:6690:0:(import.c:65:import_set_state_nolock()) ffff996f87caf000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788521694.157990:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2360:x1875400799029888:12345-192.168.206.48@tcp:8: Request processed in 309us (2069us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521694.157996:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 9 00000004:00080000:1.0:1788521694.172215:0:5836:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 16967us 00000004:00200000:1.0:1788521694.179775:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788521694.179879:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f8574b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+6:5586:x1875400799030016:12345-192.168.206.48@tcp:33: Request processed in 24738us (24919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521694.179890:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 0 00010000:00010000:2.0:1788521694.351486:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521694.438187:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521694.438319:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799030272 00000100:00100000:2.0:1788521694.438329:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799030272 00000100:00100000:2.0:1788521694.438384:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:2.0:1788521694.438394:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+6:5625:x1875400799030272:12345-192.168.206.48@tcp:101: 00010000:00010000:2.0:1788521694.438412:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521694.438488:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8149c800/0x1b7b50db5927bc24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd008a5 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521694.438566:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a800/0x1b7b50db5927bc2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521694.438581:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a800/0x1b7b50db5927bc2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521694.438596:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a800/0x1b7b50db5927bc2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521694.438636:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788521694.438640:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521694.438655:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a800/0x1b7b50db5927bc2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521694.438679:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8149c800/0x1b7b50db5927bc24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008a5 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521694.438697:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a800/0x1b7b50db5927bc2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008a5 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521694.438704:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19ef000) 00010000:00010000:2.0:1788521694.438707:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788521694.438710:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490a800, rc 0) 00000100:00100000:2.0:1788521694.438763:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+7:5625:x1875400799030272:12345-192.168.206.48@tcp:101: Request processed in 371us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521694.438781:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 8 00010000:00010000:0.0:1788521695.374335:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788521696.160797:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4bd13e8f-aac9-42ad-8625-a542705d6920 00010000:00010000:0.0:1788521696.398296:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521696.491285:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521696.492728:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799030400 00000100:00100000:1.0:1788521696.492743:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799030400 00000100:00100000:0.0:1788521696.495370:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:0.0:1788521696.495386:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+7:5678:x1875400799030400:12345-192.168.206.48@tcp:41: 00000004:00000024:0.0:1788521696.495432:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788521696.495518:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+7:5678:x1875400799030400:12345-192.168.206.48@tcp:41: Request processed in 135us (4241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521696.495525:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00080000:3.0:1788521696.496387:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521696.500239:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521696.500477:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799030528 00000100:00100000:1.0:1788521696.500487:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799030528 00000100:00100000:1.0:1788521696.500580:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:1.0:1788521696.500591:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85748000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4bd13e8f-aac9-42ad-8625-a542705d6920+5:5678:x1875400799030528:12345-192.168.206.48@tcp:13: 00002000:00000024:1.0:1788521696.500634:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521696.500695:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85748000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4bd13e8f-aac9-42ad-8625-a542705d6920+5:5678:x1875400799030528:12345-192.168.206.48@tcp:13: Request processed in 106us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521696.500703:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00080000:3.0:1788521696.501636:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521696.503404:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521696.503499:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799030656 00000100:00100000:2.0:1788521696.503508:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799030656 00000100:00100000:2.0:1788521696.503756:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:2.0:1788521696.503767:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4bd13e8f-aac9-42ad-8625-a542705d6920+6:5678:x1875400799030656:12345-192.168.206.48@tcp:13: 00002000:00000024:2.0:1788521696.503804:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521696.503867:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4bd13e8f-aac9-42ad-8625-a542705d6920+6:5678:x1875400799030656:12345-192.168.206.48@tcp:13: Request processed in 103us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521696.503874:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00080000:3.0:1788521696.504403:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521696.590504:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875400816877056:0@lo:400: 00000100:00100000:2.0:1788521696.590602:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521696.590672:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788521696.590679:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816877184:0@lo:400: 00000100:00100000:2.0:1788521696.590704:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521696.590895:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816877056 00000100:00100000:3.0:1788521696.590903:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816877056 00000100:00100000:3.0:1788521696.590961:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788521696.590971:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875400816877056:12345-0@lo:400: 00000100:00100000:3.0:1788521696.591025:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875400816877056:12345-0@lo:400: Request processed in 55us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521696.591032:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788521696.591075:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875400816877056:0@lo:400: 00000100:00100000:0.0:1788521696.591172:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816876800:0@lo:400: 00000100:00100000:0.0:1788521696.591207:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521696.591240:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875400816877312:0@lo:400: 00000100:00100000:0.0:1788521696.591262:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521696.591283:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788521696.591289:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816876928:0@lo:400: 00000100:00100000:0.0:1788521696.591310:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521696.591325:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816877440:0@lo:400: 00000100:00100000:0.0:1788521696.591344:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521696.591379:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816877184 00000100:00100000:0.0:1788521696.591383:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816877184 00000100:00100000:0.0:1788521696.591408:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816877440 00000100:00100000:0.0:1788521696.591411:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816877440 00000100:00100000:0.0:1788521696.591425:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521696.591430:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816877184:12345-0@lo:400: 00000100:00100000:0.0:1788521696.591463:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816877184:12345-0@lo:400: Request processed in 33us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521696.591470:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521696.591484:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788521696.591490:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816877440:12345-0@lo:400: 00000100:00100000:0.0:1788521696.591656:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816877440:12345-0@lo:400: Request processed in 166us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521696.591663:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788521696.591681:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816877312 00000100:00100000:0.0:1788521696.591685:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816877312 00000100:00100000:0.0:1788521696.591702:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816876928 00000100:00100000:0.0:1788521696.591705:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816876928 00000100:00100000:0.0:1788521696.591716:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788521696.591723:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875400816877312:12345-0@lo:400: 00000100:00100000:0.0:1788521696.591752:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875400816877312:12345-0@lo:400: Request processed in 30us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521696.591759:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788521696.591770:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788521696.591776:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816876928:12345-0@lo:400: 00000100:00100000:0.0:1788521696.591801:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816876928:12345-0@lo:400: Request processed in 26us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521696.591807:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788521696.591844:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816876928:0@lo:400: 00010000:00080000:0.0:1788521696.591857:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb7a89500 x1875400816877440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521696.591867:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788521696.591877:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816877440:0@lo:400: 00000100:00100000:0.0:1788521696.591888:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875400816877312:0@lo:400: 00000100:00100000:3.0:1788521696.591966:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816876800 00000100:00100000:3.0:1788521696.591971:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816876800 00000100:00100000:3.0:1788521696.592002:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788521696.592008:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3304:x1875400816876800:12345-0@lo:400: 00000100:00100000:3.0:1788521696.592047:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3304:x1875400816876800:12345-0@lo:400: Request processed in 39us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521696.592054:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00080000:3.0:1788521696.592097:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb7a8b480 x1875400816877184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521696.592107:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816877184:0@lo:400: 00000100:00080000:2.0:1788521696.592805:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521696.592811:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788521696.592814:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521696.592921:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816876800:0@lo:400: 00000100:00100000:0.0:1788521697.103916:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82a63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816877568:0@lo:13: 00000100:00100000:0.0:1788521697.103988:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521697.104066:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816877568 00000100:00100000:0.0:1788521697.104075:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816877568 00000100:00100000:0.0:1788521697.104165:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788521697.104177:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816877568:12345-0@lo:13: 00002000:00000024:0.0:1788521697.104199:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521697.104246:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816877568:12345-0@lo:13: Request processed in 70us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521697.104253:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788521697.104307:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996e82a63800 x1875400816877568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521713 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521697.104326:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82a63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816877568:0@lo:13: 00010000:00010000:2.0:1788521697.423163:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788521698.188740:0:5856:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4bd13e8f-aac9-42ad-8625-a542705d6920 00000001:00100000:1.0:1788521698.189708:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4bd13e8f-aac9-42ad-8625-a542705d6920 00010000:00010000:0.0:1788521698.447240:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521698.638468:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788521698.638492:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816877696:0@lo:13: 00000100:00100000:1.0:1788521698.638556:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521698.638670:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816877696 00000100:00100000:2.0:1788521698.638678:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816877696 00000100:00100000:2.0:1788521698.638745:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788521698.638757:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816877696:12345-0@lo:13: 00002000:00000024:2.0:1788521698.638792:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521698.638849:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816877696:12345-0@lo:13: Request processed in 95us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521698.638858:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788521698.638901:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996f860d8700 x1875400816877696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521714 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521698.638920:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816877696:0@lo:13: 00000100:00080000:1.0:1788521698.639283:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1788521699.140705:0:8297:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788521699.470345:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521699.597486:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521699.597534:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521699.597581:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521699.597804:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799030784 00000100:00100000:2.0:1788521699.597815:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799030784 00000100:00100000:2.0:1788521699.597874:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 128 00000100:00100000:2.0:1788521699.597887:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86014c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+10:2364:x1875400799030784:12345-192.168.206.48@tcp:400: 00000100:00100000:2.0:1788521699.597960:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86014c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+10:2364:x1875400799030784:12345-192.168.206.48@tcp:400: Request processed in 74us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521699.597979:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 128 00000100:00100000:0.0:1788521699.598282:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521699.598371:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799031040 00000100:00100000:1.0:1788521699.598376:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799031040 00000100:00100000:1.0:1788521699.598425:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799031168 00000100:00100000:1.0:1788521699.598429:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799031168 00000100:00100000:1.0:1788521699.598446:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:1.0:1788521699.598453:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2364:x1875400799031040:12345-192.168.206.48@tcp:400: 00000100:00100000:1.0:1788521699.598492:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2364:x1875400799031040:12345-192.168.206.48@tcp:400: Request processed in 40us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521699.598500:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:1.0:1788521699.598514:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:1.0:1788521699.598520:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2364:x1875400799031168:12345-192.168.206.48@tcp:400: 00000100:00100000:1.0:1788521699.598543:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2364:x1875400799031168:12345-192.168.206.48@tcp:400: Request processed in 24us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521699.598549:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00080000:0.0:1788521699.599126:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788521699.599132:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521699.599437:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799030912 00000100:00100000:3.0:1788521699.599444:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799030912 00000100:00100000:3.0:1788521699.599544:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:3.0:1788521699.599553:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2364:x1875400799030912:12345-192.168.206.48@tcp:400: 00000100:00100000:3.0:1788521699.599616:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2364:x1875400799030912:12345-192.168.206.48@tcp:400: Request processed in 65us (2034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521699.599624:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00080000:0.0:1788521699.600409:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788521700.495285:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521701.518606:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521701.713778:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875400816878080:0@lo:400: 00000100:00100000:0.0:1788521701.713889:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816877824:0@lo:400: 00000100:00100000:1.0:1788521701.713998:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875400816877952:0@lo:400: 00000100:00100000:0.0:1788521701.715569:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521701.715622:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875400816878336:0@lo:400: 00000100:00100000:0.0:1788521701.715652:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521701.715692:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816877824 00000100:00100000:0.0:1788521701.715699:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816877824 00000100:00100000:0.0:1788521701.715738:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788521701.715746:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3304:x1875400816877824:12345-0@lo:400: 00000100:00100000:0.0:1788521701.715792:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3304:x1875400816877824:12345-0@lo:400: Request processed in 48us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521701.715799:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788521701.715827:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816878336 00000100:00100000:0.0:1788521701.715830:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816878336 00000100:00100000:0.0:1788521701.715860:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788521701.715867:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875400816878336:12345-0@lo:400: 00000100:00100000:0.0:1788521701.715895:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875400816878336:12345-0@lo:400: Request processed in 30us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521701.718066:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788521701.718258:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521701.718303:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816877824:0@lo:400: 00000100:00100000:0.0:1788521701.718324:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875400816878336:0@lo:400: 00000100:00100000:3.0:1788521701.718386:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816878208:0@lo:400: 00000100:00100000:3.0:1788521701.718440:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521701.718859:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521701.718906:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816878080 00000100:00100000:2.0:1788521701.718912:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816878080 00000100:00100000:0.0:1788521701.718951:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816878208 00000100:00100000:0.0:1788521701.718963:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816878208 00000100:00100000:2.0:1788521701.718967:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788521701.718979:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbcb31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875400816878080:12345-0@lo:400: 00000100:00100000:0.0:1788521701.719006:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788521701.719017:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816878208:12345-0@lo:400: 00000100:00100000:2.0:1788521701.719035:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbcb31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875400816878080:12345-0@lo:400: Request processed in 57us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521701.719043:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788521701.719071:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816878208:12345-0@lo:400: Request processed in 56us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521701.719079:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788521701.719082:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875400816878080:0@lo:400: 00000100:00080000:0.0:1788521701.719114:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788521701.719117:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788521701.719136:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fbcb33b80 x1875400816878208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521701.719171:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816878208:0@lo:400: 00000100:00100000:1.0:1788521701.719205:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521701.719231:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816878464:0@lo:400: 00000100:00100000:2.0:1788521701.719322:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816877952 00000100:00100000:2.0:1788521701.719327:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816877952 00000100:00100000:1.0:1788521701.719344:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521701.719393:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816878464 00000100:00100000:1.0:1788521701.719397:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816878464 00000100:00100000:1.0:1788521701.719432:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788521701.719439:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816878464:12345-0@lo:400: 00000100:00100000:1.0:1788521701.719477:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816878464:12345-0@lo:400: Request processed in 39us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521701.719484:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788521701.719498:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788521701.719507:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521701.719509:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875400816877952:12345-0@lo:400: 00010000:00080000:1.0:1788521701.719529:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fbcb32d80 x1875400816878464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521701.719542:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816878464:0@lo:400: 00000100:00100000:2.0:1788521701.719550:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875400816877952:12345-0@lo:400: Request processed in 43us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521701.719558:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788521701.719565:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875400816877952:0@lo:400: 00000100:00100000:3.0:1788521702.223029:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788521702.223055:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82a60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816878592:0@lo:13: 00000100:00100000:3.0:1788521702.223130:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521702.223422:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816878592 00000100:00100000:0.0:1788521702.223431:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816878592 00000100:00100000:0.0:1788521702.223482:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788521702.223491:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816878592:12345-0@lo:13: 00002000:00000024:0.0:1788521702.223528:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521702.223585:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816878592:12345-0@lo:13: Request processed in 95us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521702.223593:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788521702.223692:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996e82a60a80 x1875400816878592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521718 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521702.223712:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82a60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816878592:0@lo:13: 00000020:00000080:2.0:1788521702.226053:0:8444:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc37139d00 20000000:00000080:2.0:1788521702.226084:0:8444:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff996fbfc5dc00 uarg=0000000000000000 20000000:01000000:2.0:1788521702.226127:0:8444:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788521702.226130:0:8444:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788521702.226132:0:8444:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788521702.226137:0:8444:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788521702.226173:0:8444:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788521702.226188:0:8444:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788521702.226196:0:8444:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788521702.226489:0:8444:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788521702.226492:0:8444:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788521702.227245:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1788521702.227786:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1788521702.227851:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1788521702.227890:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1788521702.227905:0:8444:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788521702.227908:0:8444:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788521702.232987:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1788521702.235663:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1788521702.235740:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1788521702.235904:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1788521702.235931:0:8444:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788521702.235934:0:8444:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788521702.237978:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788521702.245829:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788521702.245908:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1788521702.245947:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1788521702.245960:0:8444:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788521702.245963:0:8444:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788521702.247759:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1788521702.248283:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1788521702.248523:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1788521702.248576:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:3.0:1788521702.248594:0:8444:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788521702.248612:0:8444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996f8392da00/0x1b7b50db5927bc32 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521702.248630:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996f8149d400/0x1b7b50db5927bb2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bb28 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521702.248639:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996f8149dc00/0x1b7b50db5927bb59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bb52 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521702.248647:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996f80030c00/0x1b7b50db5927bb83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bb7c expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521702.248654:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996f8149c200/0x1b7b50db5927bb91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bb8a expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521702.248661:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996f829d5000/0x1b7b50db5927bb9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bb98 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521702.248668:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996f8149de00/0x1b7b50db5927bbbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bbb4 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521702.248674:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996f829d5600/0x1b7b50db5927bbe5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bbde expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521702.248691:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996f829d4400/0x1b7b50db5927bbf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00843 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521702.248698:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996f8149c600/0x1b7b50db5927bbfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0084a expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521702.248705:0:8444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996f8392da00/0x1b7b50db5927bc32 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521702.248753:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996f8149c600/0x1b7b50db5927bbfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0084a expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521702.248773:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996f8149c600/0x1b7b50db5927bbfa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0084a expref: 9 pid: 5827 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521702.248787:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a88e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1875400816878720:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788521702.248913:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996f829d4400/0x1b7b50db5927bbf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00843 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521702.248922:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996f829d4400/0x1b7b50db5927bbf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00843 expref: 9 pid: 5826 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521702.248930:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a8a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1875400816878848:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788521702.248959:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996f829d5600/0x1b7b50db5927bbe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927bbde expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521702.248967:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996f829d5600/0x1b7b50db5927bbe5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927bbde expref: 18 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521702.248988:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a88700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1875400816878976:0@lo:104: 00000100:00100000:3.0:1788521702.249027:0:8444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788521702.249061:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996f8149de00/0x1b7b50db5927bbbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927bbb4 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521702.249069:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996f8149de00/0x1b7b50db5927bbbb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927bbb4 expref: 18 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521702.249077:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a88380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1875400816879104:0@lo:104: 00000100:00100000:3.0:1788521702.249111:0:8444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788521702.249166:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996f829d5000/0x1b7b50db5927bb9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927bb98 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521702.249174:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996f829d5000/0x1b7b50db5927bb9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927bb98 expref: 18 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521702.249182:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a8b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1875400816879232:0@lo:104: 00010000:00010000:3.0:1788521702.249209:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996f8149c200/0x1b7b50db5927bb91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927bb8a expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521702.249217:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996f8149c200/0x1b7b50db5927bb91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927bb8a expref: 18 pid: 5826 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521702.249225:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a89880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1875400816879360:0@lo:104: 00010000:00010000:3.0:1788521702.249246:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996f80030c00/0x1b7b50db5927bb83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927bb7c expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521702.249254:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996f80030c00/0x1b7b50db5927bb83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927bb7c expref: 18 pid: 5827 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521702.249270:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a8aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1875400816879488:0@lo:104: 00010000:00010000:3.0:1788521702.249295:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996f8149dc00/0x1b7b50db5927bb59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927bb52 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521702.249376:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996f8149dc00/0x1b7b50db5927bb59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927bb52 expref: 18 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521702.249386:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a88a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1875400816879616:0@lo:104: 00010000:00010000:3.0:1788521702.249413:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996f8149d400/0x1b7b50db5927bb2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927bb28 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521702.249421:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996f8149d400/0x1b7b50db5927bb2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927bb28 expref: 18 pid: 5827 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521702.249429:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a8a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1875400816879744:0@lo:104: 00000100:00100000:3.0:1788521702.249445:0:8444:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb7efd600 going to sleep for 11 seconds 00000100:00100000:0.0:1788521702.249742:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788521702.249777:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521702.249791:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521702.249800:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521702.249809:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521702.249817:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521702.249825:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816878976 00000100:00100000:0.0:1788521702.249831:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816878976 00000100:00100000:0.0:1788521702.249874:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816879104 00000100:00100000:0.0:1788521702.249877:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816879104 00000100:00100000:0.0:1788521702.249888:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816879232 00000100:00100000:0.0:1788521702.249890:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816879232 00000100:00100000:0.0:1788521702.249897:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816879360 00000100:00100000:0.0:1788521702.249900:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816879360 00000100:00100000:0.0:1788521702.249908:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816879488 00000100:00100000:0.0:1788521702.249910:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816879488 00000100:00100000:0.0:1788521702.249919:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816879616 00000100:00100000:0.0:1788521702.249922:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816879616 00000100:00100000:0.0:1788521702.249931:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816879744 00000100:00100000:0.0:1788521702.249933:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816879744 00000100:00100000:0.0:1788521702.249946:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788521702.249954:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+9:8444:x1875400816878976:12345-0@lo:104: 00010000:00010000:0.0:1788521702.249967:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996f80030600/0x1b7b50db5927bbde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bbe5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.250019:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788521702.250025:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+9:8444:x1875400816878976:12345-0@lo:104: Request processed in 72us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521702.250031:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788521702.250051:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788521702.250058:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc6b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+8:8444:x1875400816879104:12345-0@lo:104: 00010000:00010000:0.0:1788521702.250066:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bbb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bbbb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.250111:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788521702.250116:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc6b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+8:8444:x1875400816879104:12345-0@lo:104: Request processed in 60us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521702.250121:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788521702.250181:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788521702.250188:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+7:8444:x1875400816879232:12345-0@lo:104: 00010000:00010000:0.0:1788521702.250195:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996f8149d800/0x1b7b50db5927bb98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bb9f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.250227:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788521702.250233:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+7:8444:x1875400816879232:12345-0@lo:104: Request processed in 46us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521702.250238:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788521702.250250:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788521702.250256:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+6:8444:x1875400816879360:12345-0@lo:104: 00010000:00010000:0.0:1788521702.250263:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996f829d5400/0x1b7b50db5927bb8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bb91 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.250287:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788521702.250292:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+6:8444:x1875400816879360:12345-0@lo:104: Request processed in 36us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521702.250297:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788521702.250320:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788521702.250327:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+5:8444:x1875400816879488:12345-0@lo:104: 00010000:00010000:0.0:1788521702.250334:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996f8392d000/0x1b7b50db5927bb7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bb83 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.250360:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788521702.250366:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+5:8444:x1875400816879488:12345-0@lo:104: Request processed in 40us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521702.250371:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788521702.250389:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788521702.250395:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85749180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+4:8444:x1875400816879616:12345-0@lo:104: 00010000:00010000:0.0:1788521702.250403:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996f80030a00/0x1b7b50db5927bb52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bb59 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.250428:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788521702.250434:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85749180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+4:8444:x1875400816879616:12345-0@lo:104: Request processed in 39us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521702.250439:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788521702.250455:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788521702.250460:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85748380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+3:8444:x1875400816879744:12345-0@lo:104: 00010000:00010000:0.0:1788521702.250467:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996f8149d600/0x1b7b50db5927bb28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bb2f expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.250490:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1788521702.250496:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85748380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+3:8444:x1875400816879744:12345-0@lo:104: Request processed in 36us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521702.250501:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788521702.250903:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a88700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1875400816878976:0@lo:104: 00000100:00100000:3.0:1788521702.250912:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a88380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1875400816879104:0@lo:104: 00000100:00100000:3.0:1788521702.250918:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a8b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1875400816879232:0@lo:104: 00000100:00100000:3.0:1788521702.250925:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a89880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1875400816879360:0@lo:104: 00000100:00100000:3.0:1788521702.250931:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a8aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1875400816879488:0@lo:104: 00000100:00100000:3.0:1788521702.250936:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a88a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1875400816879616:0@lo:104: 00000100:00100000:3.0:1788521702.250942:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a8a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1875400816879744:0@lo:104: 00010000:00010000:0.0:1788521702.254674:0:7631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788521702.254688:0:7631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f80030600/0x1b7b50db5927bbde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bbe5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.254699:0:7631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80030600 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:0.0:1788521702.254703:0:7631:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f80030600/0x1b7b50db5927bbde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927bbe5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.254713:0:7631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f80030600/0x1b7b50db5927bbde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927bbe5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521702.254735:0:7631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f80030600/0x1b7b50db5927bbde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927bbe5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521702.254741:0:7631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521702.254805:0:7631:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f80030600/0x1b7b50db5927bbde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bbe5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.254811:0:7631:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521702.254842:0:7631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f80030600/0x1b7b50db5927bbde lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bbe5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.254850:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f80030600/0x1b7b50db5927bbde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bbe5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.254865:0:7631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788521702.254868:0:7631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bbb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bbbb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.254873:0:7631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80031800 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:0.0:1788521702.254876:0:7631:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bbb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927bbbb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.254882:0:7631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bbb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927bbbb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521702.254888:0:7631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bbb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927bbbb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521702.254893:0:7631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521702.254913:0:7631:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bbb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bbbb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.254919:0:7631:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521702.254932:0:7631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bbb4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bbbb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.254938:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bbb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bbbb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.254949:0:7631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788521702.254952:0:7631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f8149d800/0x1b7b50db5927bb98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bb9f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.254958:0:7631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8149d800 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:0.0:1788521702.254961:0:7631:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f8149d800/0x1b7b50db5927bb98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927bb9f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.254967:0:7631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f8149d800/0x1b7b50db5927bb98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927bb9f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521702.254973:0:7631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f8149d800/0x1b7b50db5927bb98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927bb9f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521702.254978:0:7631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521702.254991:0:7631:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f8149d800/0x1b7b50db5927bb98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bb9f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.254997:0:7631:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521702.255002:0:7631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f8149d800/0x1b7b50db5927bb98 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bb9f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.255018:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f8149d800/0x1b7b50db5927bb98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bb9f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.255028:0:7631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788521702.255031:0:7631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f829d5400/0x1b7b50db5927bb8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bb91 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.255037:0:7631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d5400 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:0.0:1788521702.255040:0:7631:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f829d5400/0x1b7b50db5927bb8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927bb91 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.255047:0:7631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f829d5400/0x1b7b50db5927bb8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927bb91 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521702.255053:0:7631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f829d5400/0x1b7b50db5927bb8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927bb91 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521702.255058:0:7631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521702.255070:0:7631:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f829d5400/0x1b7b50db5927bb8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bb91 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.255075:0:7631:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521702.255080:0:7631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f829d5400/0x1b7b50db5927bb8a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bb91 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.255086:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f829d5400/0x1b7b50db5927bb8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bb91 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.255094:0:7631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788521702.255113:0:7631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f8392d000/0x1b7b50db5927bb7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bb83 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.255119:0:7631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392d000 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:0.0:1788521702.255122:0:7631:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f8392d000/0x1b7b50db5927bb7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927bb83 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.255128:0:7631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f8392d000/0x1b7b50db5927bb7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927bb83 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521702.255134:0:7631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f8392d000/0x1b7b50db5927bb7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927bb83 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521702.255139:0:7631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521702.255172:0:7631:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f8392d000/0x1b7b50db5927bb7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bb83 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.255178:0:7631:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521702.255182:0:7631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f8392d000/0x1b7b50db5927bb7c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bb83 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.255188:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f8392d000/0x1b7b50db5927bb7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bb83 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.255197:0:7631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788521702.255199:0:7631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f80030a00/0x1b7b50db5927bb52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bb59 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.255205:0:7631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80030a00 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:0.0:1788521702.255208:0:7631:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f80030a00/0x1b7b50db5927bb52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927bb59 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.255224:0:7631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f80030a00/0x1b7b50db5927bb52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927bb59 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521702.255230:0:7631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f80030a00/0x1b7b50db5927bb52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927bb59 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521702.255235:0:7631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521702.255248:0:7631:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f80030a00/0x1b7b50db5927bb52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bb59 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.255254:0:7631:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521702.255258:0:7631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f80030a00/0x1b7b50db5927bb52 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bb59 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.255264:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f80030a00/0x1b7b50db5927bb52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bb59 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.255272:0:7631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521702.255275:0:7631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f8149d600/0x1b7b50db5927bb28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bb2f expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.255280:0:7631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8149d600 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:0.0:1788521702.255282:0:7631:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f8149d600/0x1b7b50db5927bb28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927bb2f expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.255289:0:7631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f8149d600/0x1b7b50db5927bb28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927bb2f expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521702.255295:0:7631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f8149d600/0x1b7b50db5927bb28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927bb2f expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521702.255317:0:7631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521702.255331:0:7631:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f8149d600/0x1b7b50db5927bb28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bb2f expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.255337:0:7631:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521702.255341:0:7631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f8149d600/0x1b7b50db5927bb28 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bb2f expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.255348:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f8149d600/0x1b7b50db5927bb28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bb2f expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.255360:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521702.255362:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521702.255364:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521702.255373:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521702.255379:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521702.255395:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816880256:0@lo:103: 00000100:00100000:0.0:1788521702.255452:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521702.255500:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788521702.255507:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816879872:0@lo:103: 00000100:00100000:0.0:1788521702.255528:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521702.255544:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816880384:0@lo:103: 00000100:00100000:0.0:1788521702.255574:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521702.255601:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816880000:0@lo:103: 00000100:00100000:0.0:1788521702.255622:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521702.255637:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816880512:0@lo:103: 00000100:00100000:0.0:1788521702.255654:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521702.255678:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788521702.255683:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816880128:0@lo:103: 00000100:00100000:0.0:1788521702.255699:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521702.255706:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816880640:0@lo:103: 00000100:00100000:0.0:1788521702.255722:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521702.255743:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816880256 00000100:00100000:0.0:1788521702.255749:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816880256 00010000:00010000:0.0:1788521702.255775:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996f8149c200/0x1b7b50db5927bb91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bb8a expref: 19 pid: 5826 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521702.255795:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816879872 00000100:00100000:0.0:1788521702.255798:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816879872 00010000:00010000:0.0:1788521702.255808:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996f829d5600/0x1b7b50db5927bbe5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bbde expref: 20 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521702.255819:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816880384 00000100:00100000:0.0:1788521702.255822:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816880384 00010000:00010000:0.0:1788521702.255830:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996f80030c00/0x1b7b50db5927bb83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bb7c expref: 21 pid: 5827 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521702.255840:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816880000 00000100:00100000:0.0:1788521702.255842:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816880000 00010000:00010000:0.0:1788521702.255852:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996f8149de00/0x1b7b50db5927bbbb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bbb4 expref: 22 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521702.255861:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816880512 00000100:00100000:0.0:1788521702.255880:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816880512 00010000:00010000:0.0:1788521702.255891:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996f8149dc00/0x1b7b50db5927bb59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bb52 expref: 23 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521702.255901:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816880128 00000100:00100000:0.0:1788521702.255903:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816880128 00010000:00010000:0.0:1788521702.255932:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996f829d5000/0x1b7b50db5927bb9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bb98 expref: 24 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521702.255943:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816880640 00000100:00100000:0.0:1788521702.255946:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816880640 00010000:00010000:0.0:1788521702.255965:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996f8149d400/0x1b7b50db5927bb2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bb28 expref: 25 pid: 5827 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521702.255979:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788521702.255987:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+25:3306:x1875400816880256:12345-0@lo:103: 00010000:00010000:0.0:1788521702.256008:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521702.256013:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996f8149c200/0x1b7b50db5927bb91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bb8a expref: 25 pid: 5826 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.256030:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996f8149c200/0x1b7b50db5927bb91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927bb8a expref: 25 pid: 5826 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.256050:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8149c200/0x1b7b50db5927bb91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927bb8a expref: 25 pid: 5826 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.256069:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521702.256126:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+24:3306:x1875400816880256:12345-0@lo:103: Request processed in 133us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521702.256134:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788521702.256178:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788521702.256185:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+23:3306:x1875400816879872:12345-0@lo:103: 00010000:00010000:0.0:1788521702.256192:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521702.256196:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996f829d5600/0x1b7b50db5927bbe5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bbde expref: 23 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.256214:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996f829d5600/0x1b7b50db5927bbe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927bbde expref: 23 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.256224:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f829d5600/0x1b7b50db5927bbe5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927bbde expref: 23 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.256233:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521702.256255:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+22:3306:x1875400816879872:12345-0@lo:103: Request processed in 72us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521702.256261:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788521702.256273:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788521702.256279:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc6fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+21:3306:x1875400816880384:12345-0@lo:103: 00010000:00010000:0.0:1788521702.256288:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521702.256291:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996f80030c00/0x1b7b50db5927bb83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bb7c expref: 21 pid: 5827 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.256299:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996f80030c00/0x1b7b50db5927bb83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927bb7c expref: 21 pid: 5827 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.256309:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f80030c00/0x1b7b50db5927bb83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927bb7c expref: 21 pid: 5827 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.256317:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521702.256339:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc6fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+20:3306:x1875400816880384:12345-0@lo:103: Request processed in 61us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521702.256345:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788521702.256358:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788521702.256364:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc6fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3304:x1875400816880000:12345-0@lo:103: 00010000:00010000:0.0:1788521702.256379:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521702.256384:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996f8149de00/0x1b7b50db5927bbbb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bbb4 expref: 19 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.256392:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996f8149de00/0x1b7b50db5927bbbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927bbb4 expref: 19 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.256402:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8149de00/0x1b7b50db5927bbbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927bbb4 expref: 19 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.256410:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521702.256436:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc6fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:3304:x1875400816880000:12345-0@lo:103: Request processed in 73us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521702.256442:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788521702.256453:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788521702.256459:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc6fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:3304:x1875400816880512:12345-0@lo:103: 00010000:00010000:0.0:1788521702.256466:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521702.256470:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996f8149dc00/0x1b7b50db5927bb59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bb52 expref: 17 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.256478:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996f8149dc00/0x1b7b50db5927bb59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927bb52 expref: 17 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.256487:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8149dc00/0x1b7b50db5927bb59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927bb52 expref: 17 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.256495:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521702.256516:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc6fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:3304:x1875400816880512:12345-0@lo:103: Request processed in 57us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521702.256521:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788521702.256540:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788521702.256545:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc6ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:3304:x1875400816880128:12345-0@lo:103: 00010000:00010000:0.0:1788521702.256553:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521702.256557:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996f829d5000/0x1b7b50db5927bb9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bb98 expref: 15 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.256564:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996f829d5000/0x1b7b50db5927bb9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927bb98 expref: 15 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.256573:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f829d5000/0x1b7b50db5927bb9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927bb98 expref: 15 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.256582:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521702.256603:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc6ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:3304:x1875400816880128:12345-0@lo:103: Request processed in 57us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521702.256608:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788521702.256621:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788521702.256626:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f9130a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:3304:x1875400816880640:12345-0@lo:103: 00010000:00010000:0.0:1788521702.256633:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521702.256637:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996f8149d400/0x1b7b50db5927bb2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bb28 expref: 13 pid: 5827 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.256645:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996f8149d400/0x1b7b50db5927bb2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927bb28 expref: 13 pid: 5827 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.256655:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8149d400/0x1b7b50db5927bb2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927bb28 expref: 13 pid: 5827 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.256663:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521702.256683:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f9130a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:3304:x1875400816880640:12345-0@lo:103: Request processed in 57us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521702.256695:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788521702.256791:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816880128:0@lo:103: 00000100:00100000:0.0:1788521702.256799:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816880640:0@lo:103: 00000100:00100000:0.0:1788521702.256805:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816880000:0@lo:103: 00000100:00100000:0.0:1788521702.256810:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816880512:0@lo:103: 00000100:00100000:0.0:1788521702.256869:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816879872:0@lo:103: 00000100:00100000:0.0:1788521702.256878:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816880384:0@lo:103: 00000100:00100000:0.0:1788521702.256884:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816880256:0@lo:103: 00000100:00100000:2.0:1788521702.258016:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a88e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1875400816878720:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788521702.258030:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a8a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1875400816878848:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788521702.258065:0:8444:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996f8392da00/0x1b7b50db5927bc32 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521702.258587:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521702.258645:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799031296 00000100:00100000:0.0:1788521702.258653:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799031296 00010000:00010000:0.0:1788521702.258685:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996f8149c600/0x1b7b50db5927bbfa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0084a expref: 10 pid: 5827 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521702.258863:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:0.0:1788521702.258874:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbcb32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8401310-f5ba-4cf2-b118-0866831b1010+10:2364:x1875400799031296:12345-192.168.206.48@tcp:103: 00010000:00010000:0.0:1788521702.258888:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521702.258894:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996f8149c600/0x1b7b50db5927bbfa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0084a expref: 10 pid: 5827 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.258910:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996f8149c600/0x1b7b50db5927bbfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0084a expref: 10 pid: 5827 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.258925:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8149c600/0x1b7b50db5927bbfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0084a expref: 10 pid: 5827 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.258955:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521702.259008:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbcb32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8401310-f5ba-4cf2-b118-0866831b1010+9:2364:x1875400799031296:12345-192.168.206.48@tcp:103: Request processed in 135us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521702.259015:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:1.0:1788521702.260954:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521702.261015:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799031424 00000100:00100000:0.0:1788521702.261024:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799031424 00010000:00010000:0.0:1788521702.261055:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996f829d4400/0x1b7b50db5927bbf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00843 expref: 9 pid: 5826 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521702.261091:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:0.0:1788521702.261111:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98072680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8401310-f5ba-4cf2-b118-0866831b1010+9:2363:x1875400799031424:12345-192.168.206.48@tcp:103: 00010000:00010000:0.0:1788521702.261125:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521702.261130:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996f829d4400/0x1b7b50db5927bbf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00843 expref: 9 pid: 5826 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.261168:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996f829d4400/0x1b7b50db5927bbf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00843 expref: 9 pid: 5826 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.261185:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f829d4400/0x1b7b50db5927bbf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00843 expref: 9 pid: 5826 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.261201:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996f8392da00/0x1b7b50db5927bc32 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.261211:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8392da00/0x1b7b50db5927bc32 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.261226:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996f8392da00/0x1b7b50db5927bc32 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.261245:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996f8392da00/0x1b7b50db5927bc32 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.261251:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996f8392da00/0x1b7b50db5927bc32 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.261257:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996f8392da00/0x1b7b50db5927bc32 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.261262:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392da00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521702.261265:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996f8392da00/0x1b7b50db5927bc32 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.261272:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996f8392da00/0x1b7b50db5927bc32 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521702.261565:0:8444:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996f8392da00/0x1b7b50db5927bc32 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521702.261575:0:8444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996f8392da00/0x1b7b50db5927bc32 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.262673:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996f8392da00/0x1b7b50db5927bc32 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.262686:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8392da00/0x1b7b50db5927bc32 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521702.262704:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521702.262773:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98072680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8401310-f5ba-4cf2-b118-0866831b1010+8:2363:x1875400799031424:12345-192.168.206.48@tcp:103: Request processed in 1672us (1824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521702.262783:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 20 00010000:00010000:0.0:1788521702.542443:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521702.794875:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521702.794967:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799031552 00000100:00100000:3.0:1788521702.794977:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799031552 00000100:00100000:3.0:1788521702.795040:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 130 00000100:00100000:3.0:1788521702.795049:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+8:5600:x1875400799031552:12345-192.168.206.48@tcp:101: 00010000:00010000:3.0:1788521702.795065:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521702.795086:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f8392ce00/0x1b7b50db5927bc39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe705d7355cd008ac expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521702.795124:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8392ce00/0x1b7b50db5927bc39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008ac expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521702.795135:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f8392ce00/0x1b7b50db5927bc39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008ac expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521702.795178:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392ce00, rc 0) 00000100:00100000:3.0:1788521702.795234:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+9:5600:x1875400799031552:12345-192.168.206.48@tcp:101: Request processed in 186us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521702.795241:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 130 00000100:00100000:3.0:1788521702.797837:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521702.798135:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799031680 00000100:00100000:0.0:1788521702.798185:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799031680 00000100:00100000:0.0:1788521702.798231:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 131 00000100:00100000:0.0:1788521702.798252:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+9:5600:x1875400799031680:12345-192.168.206.48@tcp:501: 00000100:00100000:0.0:1788521702.798523:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+9:5600:x1875400799031680:12345-192.168.206.48@tcp:501: Request processed in 271us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521702.798531:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 131 00000100:00100000:1.0:1788521702.804118:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521702.804300:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799031808 00000100:00100000:0.0:1788521702.804310:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799031808 00000100:00100000:0.0:1788521702.804424:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 132 00000100:00100000:0.0:1788521702.804435:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+9:5600:x1875400799031808:12345-192.168.206.48@tcp:503: 00000100:00100000:0.0:1788521702.804654:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+9:5600:x1875400799031808:12345-192.168.206.48@tcp:503: Request processed in 220us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521702.804662:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 132 00000100:00100000:2.0:1788521702.812195:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521702.814693:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799031936 00000100:00100000:3.0:1788521702.814708:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799031936 00000100:00100000:3.0:1788521702.814832:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 133 00000100:00100000:3.0:1788521702.814851:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+9:6066:x1875400799031936:12345-192.168.206.48@tcp:502: 00000100:00100000:3.0:1788521702.815173:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+9:6066:x1875400799031936:12345-192.168.206.48@tcp:502: Request processed in 332us (2984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521702.815181:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 133 00000100:00100000:3.0:1788521702.817720:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521702.817874:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799032064 00000100:00100000:0.0:1788521702.817882:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799032064 00000100:00100000:0.0:1788521702.817933:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 134 00000100:00100000:0.0:1788521702.817944:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+9:6066:x1875400799032064:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788521702.818307:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+9:6066:x1875400799032064:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 363us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521702.818317:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 134 00000100:00100000:1.0:1788521702.825030:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521702.825627:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799032192 00000100:00100000:3.0:1788521702.825636:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799032192 00000100:00100000:3.0:1788521702.825691:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 135 00000100:00100000:3.0:1788521702.825713:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+9:5600:x1875400799032192:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521702.825730:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521702.825747:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f8392d200/0x1b7b50db5927bc40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe705d7355cd008b3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521702.827130:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8392d200/0x1b7b50db5927bc40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008b3 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521702.827158:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f8392d200/0x1b7b50db5927bc40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008b3 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521702.827167:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392d200, rc 0) 00000100:00100000:3.0:1788521702.827235:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+10:5600:x1875400799032192:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 Request processed in 1522us (2211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521702.827243:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 135 00000100:00100000:1.0:1788521702.837084:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521702.837184:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799032320 00000100:00100000:0.0:1788521702.837194:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799032320 00000100:00100000:0.0:1788521702.837259:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 136 00000100:00100000:0.0:1788521702.837269:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+10:5600:x1875400799032320:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521702.837637:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+10:5600:x1875400799032320:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 Request processed in 368us (561us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788521702.837646:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 136 10000000:01000000:1.0:1788521703.310318:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788521703.310326:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff996f86ac1800 from 39 10000000:01000000:1.0:1788521703.310332:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788521703.310386:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f829d4e00/0x1b7b50db5927bc47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521703.310397:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996f829d4e00/0x1b7b50db5927bc47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521703.310407:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f829d4e00/0x1b7b50db5927bc47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521703.310428:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816880768:0@lo:101: 00000100:00100000:1.0:1788521703.310489:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521703.310666:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cb600 going to sleep for 11 seconds 00000100:00100000:3.0:1788521703.314820:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816880768 00000100:00100000:3.0:1788521703.314834:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816880768 00000100:00100000:3.0:1788521703.314944:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788521703.314955:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+12:5830:x1875400816880768:12345-0@lo:101: 00010000:00010000:3.0:1788521703.314970:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521703.314989:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f8392c600/0x1b7b50db5927bc4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927bc47 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521703.315015:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8392c600/0x1b7b50db5927bc4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927bc47 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521703.315026:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f8392c600/0x1b7b50db5927bc4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bc47 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521703.315052:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392c600, rc 0) 00000100:00100000:3.0:1788521703.315279:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:5830:x1875400816880768:12345-0@lo:101: Request processed in 326us (4788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521703.315287:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788521703.315371:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816880768:0@lo:101: 00010000:00010000:1.0:1788521703.315398:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f829d4e00/0x1b7b50db5927bc47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bc4e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521703.315407:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f829d4e00/0x1b7b50db5927bc47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bc4e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521703.315471:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816880896:0@lo:501: 00000100:00100000:1.0:1788521703.315505:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521703.317787:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816880896 00000100:00100000:3.0:1788521703.317805:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816880896 00000100:00100000:2.0:1788521703.318004:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788521703.318015:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:5830:x1875400816880896:12345-0@lo:501: 00000100:00100000:2.0:1788521703.318350:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:5830:x1875400816880896:12345-0@lo:501: Request processed in 337us (2843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521703.318358:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788521703.318840:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cb600 going to sleep for 11 seconds 00000100:00100000:1.0:1788521703.318862:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816880896:0@lo:501: 00000100:00100000:1.0:1788521703.318912:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816881024:0@lo:503: 00000100:00100000:1.0:1788521703.318956:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521703.318976:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cb600 going to sleep for 11 seconds 00000100:00100000:3.0:1788521703.319050:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816881024 00000100:00100000:3.0:1788521703.319055:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816881024 00000100:00100000:3.0:1788521703.319079:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788521703.319086:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:5830:x1875400816881024:12345-0@lo:503: 00000100:00100000:3.0:1788521703.319409:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:5830:x1875400816881024:12345-0@lo:503: Request processed in 323us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521703.319417:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788521703.319515:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816881024:0@lo:503: 00000100:00100000:0.0:1788521703.320071:0:8464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc6fed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8464:1875400816881152:0@lo:502: 00000100:00100000:0.0:1788521703.320323:0:8464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521703.320397:0:8464:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86745780 going to sleep for 11 seconds 00000100:00100000:3.0:1788521703.322592:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816881152 00000100:00100000:3.0:1788521703.322605:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816881152 00000100:00100000:3.0:1788521703.322665:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788521703.322675:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:8464:x1875400816881152:12345-0@lo:502: 00000100:00100000:3.0:1788521703.323617:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:8464:x1875400816881152:12345-0@lo:502: Request processed in 940us (3290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521703.323627:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788521703.323667:0:8464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc6fed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8464:1875400816881152:0@lo:502: 00000100:00100000:0.0:1788521703.323732:0:8464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc6fed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8464:1875400816881280:0@lo:502: 00000100:00100000:0.0:1788521703.323775:0:8464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521703.323813:0:8464:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86745780 going to sleep for 11 seconds 00000100:00100000:2.0:1788521703.323934:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816881280 00000100:00100000:2.0:1788521703.323940:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816881280 00000100:00100000:2.0:1788521703.323979:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788521703.323987:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:8464:x1875400816881280:12345-0@lo:502: 00000100:00100000:2.0:1788521703.324195:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+13:8464:x1875400816881280:12345-0@lo:502: Request processed in 208us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521703.324246:0:8464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc6fed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8464:1875400816881280:0@lo:502: 00000040:00080000:3.0:1788521703.324267:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788521703.324357:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788521703.324384:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788521703.324394:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f829d4e00/0x1b7b50db5927bc47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bc4e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521703.324404:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996f829d4e00/0x1b7b50db5927bc47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bc4e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521703.324413:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788521703.324416:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1788521703.324418:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788521703.324443:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f829d5800/0x1b7b50db5927bc55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521703.324451:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996f829d5800/0x1b7b50db5927bc55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521703.324459:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f829d5800/0x1b7b50db5927bc55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521703.324472:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816881408:0@lo:101: 00000100:00100000:1.0:1788521703.324501:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521703.324542:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cb600 going to sleep for 11 seconds 00000100:00100000:3.0:1788521703.324563:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816881408 00000100:00100000:3.0:1788521703.324568:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816881408 00000100:00100000:3.0:1788521703.324588:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788521703.324594:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:5830:x1875400816881408:12345-0@lo:101: 00010000:00010000:3.0:1788521703.324609:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521703.324620:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f8392d600/0x1b7b50db5927bc5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927bc55 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521703.324641:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8392d600/0x1b7b50db5927bc5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927bc55 expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521703.324651:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f8392d600/0x1b7b50db5927bc5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bc55 expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521703.324660:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392d600, rc 0) 00000100:00100000:3.0:1788521703.324701:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:5830:x1875400816881408:12345-0@lo:101: Request processed in 106us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521703.324707:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788521703.324736:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788521703.325298:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816881408:0@lo:101: 00010000:00010000:1.0:1788521703.325318:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f829d5800/0x1b7b50db5927bc55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bc5c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521703.325328:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f829d5800/0x1b7b50db5927bc55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bc5c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521703.325373:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816881536:0@lo:501: 00000100:00100000:1.0:1788521703.325405:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521703.325434:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cb600 going to sleep for 11 seconds 00000100:00100000:0.0:1788521703.325625:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816881536 00000100:00100000:0.0:1788521703.325631:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816881536 00000100:00100000:0.0:1788521703.325677:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788521703.325685:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:5830:x1875400816881536:12345-0@lo:501: 00000100:00100000:0.0:1788521703.325919:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:5830:x1875400816881536:12345-0@lo:501: Request processed in 235us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521703.325927:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788521703.326060:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816881536:0@lo:501: 00000100:00100000:1.0:1788521703.326100:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816881664:0@lo:503: 00000100:00100000:1.0:1788521703.326179:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521703.326216:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cb600 going to sleep for 11 seconds 00000100:00100000:2.0:1788521703.326380:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816881664 00000100:00100000:2.0:1788521703.326384:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816881664 00000100:00100000:2.0:1788521703.326419:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788521703.326427:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:5830:x1875400816881664:12345-0@lo:503: 00000100:00100000:2.0:1788521703.326588:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:5830:x1875400816881664:12345-0@lo:503: Request processed in 161us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521703.326595:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788521703.326849:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816881664:0@lo:503: 00000100:00100000:1.0:1788521703.327369:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8465:1875400816881792:0@lo:502: 00000100:00100000:1.0:1788521703.327413:0:8465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521703.327437:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cb900 going to sleep for 11 seconds 00000100:00100000:0.0:1788521703.327496:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816881792 00000100:00100000:0.0:1788521703.327502:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816881792 00000100:00100000:0.0:1788521703.327547:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788521703.327556:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:8465:x1875400816881792:12345-0@lo:502: 00000100:00100000:0.0:1788521703.327897:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:8465:x1875400816881792:12345-0@lo:502: Request processed in 341us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521703.327904:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788521703.327996:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8465:1875400816881792:0@lo:502: 00000020:01000000:1.0:1788521703.328027:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788521703.328035:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521703.328037:0:8465:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788521703.328042:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788521703.328062:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8465:1875400816881920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521703.328105:0:8465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521703.328345:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cb900 going to sleep for 11 seconds 00000100:00100000:3.0:1788521703.331534:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816881920 00000100:00100000:3.0:1788521703.331550:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816881920 00000100:00100000:3.0:1788521703.331770:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788521703.331781:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:8465:x1875400816881920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521703.332512:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:8465:x1875400816881920:12345-0@lo:502:llog_process_th.0 Request processed in 731us (4404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521703.332521:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788521703.337486:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8465:1875400816881920:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788521703.337616:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788521703.337627:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521703.337629:0:8465:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788521703.337634:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788521703.337861:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788521703.337880:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788521703.337891:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f829d5800/0x1b7b50db5927bc55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bc5c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521703.337902:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996f829d5800/0x1b7b50db5927bc55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bc5c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521703.337928:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788521703.337931:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff996f97fff000 from 39 10000000:01000000:3.0:1788521703.337934:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788521703.337971:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392d800/0x1b7b50db5927bc63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521703.337980:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996f8392d800/0x1b7b50db5927bc63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521703.337990:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f8392d800/0x1b7b50db5927bc63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521703.338012:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a8bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816882048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788521703.338074:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521703.338196:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90f00900 going to sleep for 11 seconds 00000100:00100000:0.0:1788521703.338413:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816882048 00000100:00100000:0.0:1788521703.338420:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816882048 00000100:00100000:0.0:1788521703.338517:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788521703.338526:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:5830:x1875400816882048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521703.338548:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521703.338567:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f80030a00/0x1b7b50db5927bc6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927bc63 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521703.338590:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f80030a00/0x1b7b50db5927bc6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927bc63 expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521703.338600:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f80030a00/0x1b7b50db5927bc6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bc63 expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521703.338608:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f80030a00, rc 0) 00000100:00100000:0.0:1788521703.338663:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:5830:x1875400816882048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521703.338669:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788521703.338735:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a8bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816882048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521703.338749:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f8392d800/0x1b7b50db5927bc63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bc6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521703.338757:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f8392d800/0x1b7b50db5927bc63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bc6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521703.338803:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a8bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816882176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521703.338828:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521703.339012:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90f00900 going to sleep for 11 seconds 00000100:00100000:2.0:1788521703.339065:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816882176 00000100:00100000:2.0:1788521703.339069:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816882176 00000100:00100000:2.0:1788521703.339101:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788521703.339109:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:5830:x1875400816882176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521703.339753:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:5830:x1875400816882176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 643us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521703.339761:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788521703.339911:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a8bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816882176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521703.339943:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a8bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816882304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521703.339988:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521703.340055:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90f00900 going to sleep for 11 seconds 00000100:00100000:2.0:1788521703.340099:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816882304 00000100:00100000:2.0:1788521703.340103:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816882304 00000100:00100000:2.0:1788521703.340380:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788521703.340389:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:5830:x1875400816882304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521703.340634:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:5830:x1875400816882304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 245us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521703.340641:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788521703.340788:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a8bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816882304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521703.341320:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8466:1875400816882432:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521703.341362:0:8466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521703.341445:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521703.341479:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816882432 00000100:00100000:3.0:1788521703.341484:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816882432 00000100:00100000:3.0:1788521703.341627:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788521703.341637:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:8466:x1875400816882432:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521703.341903:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:8466:x1875400816882432:12345-0@lo:502:llog_process_th.0 Request processed in 267us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521703.341911:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788521703.341986:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8466:1875400816882432:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521703.342033:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8466:1875400816882560:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521703.342067:0:8466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521703.342198:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521703.342348:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816882560 00000100:00100000:0.0:1788521703.342352:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816882560 00000100:00100000:0.0:1788521703.342375:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788521703.342381:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:8466:x1875400816882560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521703.342527:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:8466:x1875400816882560:12345-0@lo:502:llog_process_th.0 Request processed in 146us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521703.342655:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788521703.342789:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8466:1875400816882560:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788521703.342812:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788521703.342957:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788521703.342976:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788521703.342985:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392d800/0x1b7b50db5927bc63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bc6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521703.342995:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996f8392d800/0x1b7b50db5927bc63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bc6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521703.343004:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788521703.343012:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788521703.343016:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788521703.343041:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bc71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521703.343050:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bc71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521703.343059:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bc71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521703.343075:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc6fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816882688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788521703.343287:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521703.343320:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86745540 going to sleep for 11 seconds 00000100:00100000:1.0:1788521703.343370:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816882688 00000100:00100000:1.0:1788521703.343375:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816882688 00000100:00100000:1.0:1788521703.343397:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788521703.343404:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:5830:x1875400816882688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521703.343414:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521703.343426:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f829d4200/0x1b7b50db5927bc78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927bc71 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521703.343446:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f829d4200/0x1b7b50db5927bc78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927bc71 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521703.343456:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f829d4200/0x1b7b50db5927bc78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bc71 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521703.343464:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f829d4200, rc 0) 00000100:00100000:1.0:1788521703.343503:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:5830:x1875400816882688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521703.343509:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788521703.343641:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc6fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816882688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521703.343726:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bc71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bc78 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521703.343736:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bc71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bc78 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521703.343783:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc6fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816882816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521703.343810:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521703.343864:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86745540 going to sleep for 11 seconds 00000100:00100000:3.0:1788521703.343934:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816882816 00000100:00100000:3.0:1788521703.343939:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816882816 00000100:00100000:2.0:1788521703.344042:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788521703.344052:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:5830:x1875400816882816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521703.344324:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:5830:x1875400816882816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 273us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521703.344337:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788521703.344404:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc6fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816882816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521703.344431:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc6fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816882944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521703.344467:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521703.344895:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86745540 going to sleep for 11 seconds 00000100:00100000:1.0:1788521703.344945:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816882944 00000100:00100000:1.0:1788521703.344950:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816882944 00000100:00100000:1.0:1788521703.344981:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788521703.344988:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:5830:x1875400816882944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521703.345402:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:5830:x1875400816882944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 414us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521703.345410:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788521703.345729:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc6fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816882944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521703.346065:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8467:1875400816883072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521703.346355:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521703.346418:0:8467:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f87de5000 going to sleep for 11 seconds 00000100:00100000:1.0:1788521703.346487:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816883072 00000100:00100000:1.0:1788521703.346493:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816883072 00000100:00100000:1.0:1788521703.346626:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788521703.346635:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:8467:x1875400816883072:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521703.346898:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:8467:x1875400816883072:12345-0@lo:502:llog_process_th.0 Request processed in 264us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521703.346905:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788521703.346985:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8467:1875400816883072:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788521703.347013:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521703.347022:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521703.347025:0:8467:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788521703.347031:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788521703.347054:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8467:1875400816883200:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521703.347089:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521703.347427:0:8467:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f93626000 going to sleep for 11 seconds 00000100:00100000:3.0:1788521703.347502:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816883200 00000100:00100000:3.0:1788521703.347506:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816883200 00000100:00100000:3.0:1788521703.347601:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788521703.347610:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:8467:x1875400816883200:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521703.347882:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:8467:x1875400816883200:12345-0@lo:502:llog_process_th.0 Request processed in 273us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521703.347889:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788521703.347987:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8467:1875400816883200:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788521703.348011:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521703.348016:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521703.348018:0:8467:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788521703.348022:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1788521703.348320:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788521703.348340:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788521703.348349:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bc71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bc78 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521703.348360:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bc71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bc78 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521703.348379:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788521703.348382:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff996f85616000 from 39 10000000:01000000:3.0:1788521703.348385:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788521703.348410:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392cc00/0x1b7b50db5927bc7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521703.348418:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996f8392cc00/0x1b7b50db5927bc7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521703.348426:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f8392cc00/0x1b7b50db5927bc7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521703.348443:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a8bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816883328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788521703.348472:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521703.348505:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fbc3d6240 going to sleep for 11 seconds 00000100:00100000:1.0:1788521703.348616:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816883328 00000100:00100000:1.0:1788521703.348622:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816883328 00000100:00100000:1.0:1788521703.348731:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788521703.348740:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:5830:x1875400816883328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521703.348751:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521703.348764:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f829d5400/0x1b7b50db5927bc86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927bc7f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521703.348785:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f829d5400/0x1b7b50db5927bc86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927bc7f expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521703.348795:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f829d5400/0x1b7b50db5927bc86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bc7f expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521703.348803:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f829d5400, rc 0) 00000100:00100000:1.0:1788521703.348840:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:5830:x1875400816883328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521703.348852:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788521703.348888:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a8bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816883328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521703.348900:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f8392cc00/0x1b7b50db5927bc7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bc86 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521703.348909:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f8392cc00/0x1b7b50db5927bc7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bc86 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521703.348954:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816883456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521703.348980:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521703.348994:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521703.349006:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816883456 00000100:00100000:1.0:1788521703.349009:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816883456 00000100:00100000:1.0:1788521703.349025:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788521703.349031:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:5830:x1875400816883456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521703.349410:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:5830:x1875400816883456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 378us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521703.349418:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788521703.349449:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816883456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521703.349489:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816883584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521703.349524:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521703.349620:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521703.349633:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816883584 00000100:00100000:1.0:1788521703.349637:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816883584 00000100:00100000:1.0:1788521703.349821:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788521703.349836:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:5830:x1875400816883584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521703.349966:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:5830:x1875400816883584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521703.349973:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788521703.350415:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816883584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521703.350887:0:8468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8468:1875400816883712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521703.350932:0:8468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521703.350964:0:8468:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f93626000 going to sleep for 11 seconds 00000100:00100000:3.0:1788521703.351005:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816883712 00000100:00100000:3.0:1788521703.351011:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816883712 00000100:00100000:3.0:1788521703.351045:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788521703.351053:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:8468:x1875400816883712:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521703.351517:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:8468:x1875400816883712:12345-0@lo:502:llog_process_th.0 Request processed in 463us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521703.351525:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788521703.352750:0:8468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8468:1875400816883712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521703.352819:0:8468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8468:1875400816883840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521703.352868:0:8468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521703.352903:0:8468:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f8675be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788521703.352951:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816883840 00000100:00100000:1.0:1788521703.352957:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816883840 00000100:00100000:1.0:1788521703.352997:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788521703.353006:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:8468:x1875400816883840:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521703.353407:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:8468:x1875400816883840:12345-0@lo:502:llog_process_th.0 Request processed in 402us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521703.353416:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788521703.353529:0:8468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8468:1875400816883840:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788521703.353572:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788521703.357352:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788521703.357387:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788521703.357397:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392cc00/0x1b7b50db5927bc7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bc86 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521703.357408:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996f8392cc00/0x1b7b50db5927bc7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bc86 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521703.357418:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788521703.357421:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1788521703.357423:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788521703.357460:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927bc8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521703.357468:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927bc8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521703.357488:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927bc8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521703.357513:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816883968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788521703.357766:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521703.357809:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521703.357856:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816883968 00000100:00100000:2.0:1788521703.357864:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816883968 00000100:00100000:2.0:1788521703.357918:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788521703.357926:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:5830:x1875400816883968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521703.357938:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521703.357951:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996fb490be00/0x1b7b50db5927bc94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927bc8d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521703.357972:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fb490be00/0x1b7b50db5927bc94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927bc8d expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521703.357982:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996fb490be00/0x1b7b50db5927bc94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bc8d expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521703.357990:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490be00, rc 0) 00000100:00100000:2.0:1788521703.358034:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:5830:x1875400816883968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521703.358040:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788521703.358386:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816883968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521703.358405:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927bc8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bc94 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521703.358415:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927bc8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bc94 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521703.358463:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816884096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521703.358487:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521703.358504:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521703.358572:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816884096 00000100:00100000:0.0:1788521703.358577:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816884096 00000100:00100000:0.0:1788521703.358609:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788521703.358617:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:5830:x1875400816884096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521703.358960:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:5830:x1875400816884096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 343us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521703.358968:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788521703.359435:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816884096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521703.359471:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816884224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521703.359510:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521703.359608:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816884224 00000100:00100000:3.0:1788521703.359613:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816884224 00000100:00100000:3.0:1788521703.359636:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788521703.359643:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:5830:x1875400816884224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521703.359788:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:5830:x1875400816884224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521703.359803:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788521703.359912:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521703.359928:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816884224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521703.360883:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc6fd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8469:1875400816884352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521703.360927:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521703.360959:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f867450c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521703.361011:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816884352 00000100:00100000:2.0:1788521703.361017:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816884352 00000100:00100000:2.0:1788521703.361055:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788521703.361063:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:8469:x1875400816884352:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521703.361863:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:8469:x1875400816884352:12345-0@lo:502:llog_process_th.0 Request processed in 799us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521703.361873:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788521703.367774:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc6fd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8469:1875400816884352:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788521703.367830:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521703.367842:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521703.367844:0:8469:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788521703.367850:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788521703.367885:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc6fd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8469:1875400816884480:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521703.367955:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521703.367996:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f867450c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521703.368369:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816884480 00000100:00100000:2.0:1788521703.368377:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816884480 00000100:00100000:2.0:1788521703.368436:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788521703.368445:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:8469:x1875400816884480:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521703.369750:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:8469:x1875400816884480:12345-0@lo:502:llog_process_th.0 Request processed in 1301us (1790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521703.369760:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788521703.369972:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc6fd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8469:1875400816884480:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788521703.370005:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521703.370011:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521703.370014:0:8469:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788521703.370019:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788521703.370420:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1788521703.370439:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788521703.370450:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927bc8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bc94 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521703.370469:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927bc8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bc94 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521703.370479:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788521703.370481:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff996f8606b380 from 1 10000000:01000000:1.0:1788521703.370483:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788521703.370510:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f829d5000/0x1b7b50db5927bc9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521703.370517:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996f829d5000/0x1b7b50db5927bc9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521703.370525:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f829d5000/0x1b7b50db5927bc9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521703.370610:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816884608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788521703.370647:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521703.370783:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521703.370816:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816884608 00000100:00100000:2.0:1788521703.370822:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816884608 00000100:00100000:2.0:1788521703.370906:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788521703.370914:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:5830:x1875400816884608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521703.370926:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521703.370938:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996fb490a600/0x1b7b50db5927bca2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927bc9b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521703.370959:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fb490a600/0x1b7b50db5927bca2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927bc9b expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521703.370969:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996fb490a600/0x1b7b50db5927bca2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bc9b expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521703.370977:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490a600, rc 0) 00000100:00100000:2.0:1788521703.371017:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:5830:x1875400816884608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521703.371023:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788521703.371085:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816884608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521703.371112:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f829d5000/0x1b7b50db5927bc9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bca2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521703.371131:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f829d5000/0x1b7b50db5927bc9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bca2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521703.371212:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816884736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521703.371237:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521703.371488:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521703.371602:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816884736 00000100:00100000:3.0:1788521703.371607:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816884736 00000100:00100000:3.0:1788521703.371632:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788521703.371639:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:5830:x1875400816884736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521703.371964:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:5830:x1875400816884736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 325us (724us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788521703.371971:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788521703.372078:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816884736:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788521703.372114:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788521703.375778:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f829d5000/0x1b7b50db5927bc9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bca2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521703.375792:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996f829d5000/0x1b7b50db5927bc9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bca2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521703.566348:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521703.758341:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816884864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521703.758401:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521703.758447:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816884864 00000100:00100000:3.0:1788521703.758454:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816884864 00000100:00080000:2.0:1788521703.758488:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521703.758506:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788521703.758516:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbcb33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816884864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788521703.758547:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521703.758601:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbcb33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816884864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521703.758607:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788521703.758696:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fbcb30000 x1875400816884864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521719 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521703.758728:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816884864:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1788521704.180416:0:8506:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcfa7968f0 20000000:00000080:0.0:1788521704.180436:0:8506:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff996fb4a76c00 uarg=0000000000000000 20000000:01000000:0.0:1788521704.180476:0:8506:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788521704.180481:0:8506:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788521704.180486:0:8506:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788521704.181504:0:8507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1788521704.181662:0:8506:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1788521704.188787:0:8506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1788521704.188862:0:8506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1788521704.188920:0:8506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1788521704.188938:0:8506:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788521704.188958:0:8506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996f829d4400/0x1b7b50db5927bca9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521704.188976:0:8506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996f829d5a00/0x1b7b50db5927ba1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927ba17 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521704.188984:0:8506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996f8149cc00/0x1b7b50db5927ba80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927ba79 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521704.188992:0:8506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bb4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bb44 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521704.189000:0:8506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996f8149c400/0x1b7b50db5927bc08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0087b expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521704.189007:0:8506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996f829d4400/0x1b7b50db5927bca9 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521704.189059:0:8506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996f8149c400/0x1b7b50db5927bc08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0087b expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521704.189078:0:8506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996f8149c400/0x1b7b50db5927bc08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0087b expref: 9 pid: 5826 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521704.189102:0:8506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875400816884992:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788521704.189232:0:8506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bb4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927bb44 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521704.189240:0:8506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bb4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927bb44 expref: 18 pid: 5827 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521704.189248:0:8506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875400816885120:0@lo:104: 00000100:00100000:1.0:1788521704.189285:0:8506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788521704.189330:0:8506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996f8149cc00/0x1b7b50db5927ba80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927ba79 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521704.189339:0:8506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996f8149cc00/0x1b7b50db5927ba80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927ba79 expref: 18 pid: 5826 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521704.189760:0:8506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875400816885248:0@lo:104: 00000100:00100000:1.0:1788521704.189792:0:8506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788521704.189835:0:8506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996f829d5a00/0x1b7b50db5927ba1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927ba17 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521704.189843:0:8506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996f829d5a00/0x1b7b50db5927ba1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927ba17 expref: 18 pid: 5827 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521704.189863:0:8506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875400816885376:0@lo:104: 00000100:00100000:1.0:1788521704.189883:0:8506:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521704.190016:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788521704.190034:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521704.190046:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816885120 00000100:00100000:3.0:1788521704.190051:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816885120 00000100:00100000:3.0:1788521704.190082:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816885248 00000100:00100000:3.0:1788521704.190084:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816885248 00000100:00100000:3.0:1788521704.190110:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816885376 00000100:00100000:3.0:1788521704.190112:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816885376 00000100:00100000:3.0:1788521704.190138:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788521704.190183:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98072a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+5:8506:x1875400816885120:12345-0@lo:104: 00010000:00010000:3.0:1788521704.190204:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996f8392de00/0x1b7b50db5927bb44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bb4b expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521704.190252:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788521704.190258:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98072a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+5:8506:x1875400816885120:12345-0@lo:104: Request processed in 78us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521704.190265:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788521704.190280:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788521704.190286:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+4:8506:x1875400816885248:12345-0@lo:104: 00010000:00010000:3.0:1788521704.190293:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996f8392c000/0x1b7b50db5927ba79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927ba80 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521704.190324:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788521704.190329:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+4:8506:x1875400816885248:12345-0@lo:104: Request processed in 44us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521704.190335:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788521704.190377:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788521704.190383:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+3:8506:x1875400816885376:12345-0@lo:104: 00010000:00010000:3.0:1788521704.190391:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927ba17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927ba1e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521704.190423:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788521704.190428:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+3:8506:x1875400816885376:12345-0@lo:104: Request processed in 45us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521704.190433:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1788521704.190454:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788521704.190460:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f8392de00/0x1b7b50db5927bb44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bb4b expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521704.190473:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392de00 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:3.0:1788521704.190477:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f8392de00/0x1b7b50db5927bb44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927bb4b expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521704.190486:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f8392de00/0x1b7b50db5927bb44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927bb4b expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521704.190493:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f8392de00/0x1b7b50db5927bb44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927bb4b expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521704.190498:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788521704.190523:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f8392de00/0x1b7b50db5927bb44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bb4b expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521704.190529:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788521704.190556:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f8392de00/0x1b7b50db5927bb44 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bb4b expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521704.190563:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f8392de00/0x1b7b50db5927bb44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bb4b expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521704.190565:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816885504:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788521704.190582:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788521704.190585:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f8392c000/0x1b7b50db5927ba79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927ba80 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521704.190591:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392c000 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:3.0:1788521704.190594:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f8392c000/0x1b7b50db5927ba79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927ba80 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521704.190604:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788521704.190614:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f8392c000/0x1b7b50db5927ba79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927ba80 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521704.190620:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f8392c000/0x1b7b50db5927ba79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927ba80 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521704.190625:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788521704.190639:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f8392c000/0x1b7b50db5927ba79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927ba80 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521704.190645:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788521704.190831:0:8506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875400816885120:0@lo:104: 00000100:00100000:1.0:1788521704.190840:0:8506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875400816885248:0@lo:104: 00000100:00100000:1.0:1788521704.190847:0:8506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875400816885376:0@lo:104: 00010000:00010000:3.0:1788521704.190957:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f8392c000/0x1b7b50db5927ba79 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927ba80 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521704.190965:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f8392c000/0x1b7b50db5927ba79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927ba80 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521704.190975:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521704.190979:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927ba17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927ba1e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521704.190984:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80031a00 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:3.0:1788521704.190987:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927ba17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927ba1e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521704.190993:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927ba17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927ba1e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521704.191000:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927ba17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927ba1e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521704.191011:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788521704.191037:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927ba17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927ba1e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521704.191043:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788521704.191049:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927ba17 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927ba1e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521704.191055:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927ba17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927ba1e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521704.191069:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521704.191070:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521704.191072:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521704.191078:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521704.191083:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521704.191106:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816885504 00000100:00100000:3.0:1788521704.191117:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816885504 00010000:00010000:3.0:1788521704.191137:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bb4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bb44 expref: 19 pid: 5827 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521704.191193:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788521704.191200:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc6fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3307:x1875400816885504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788521704.191210:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521704.191215:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bb4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bb44 expref: 19 pid: 5827 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521704.191224:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bb4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927bb44 expref: 19 pid: 5827 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521704.191247:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bb4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927bb44 expref: 19 pid: 5827 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521704.191257:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521704.191290:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc6fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:3307:x1875400816885504:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521704.191297:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788521704.191318:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816885632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521704.191342:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521704.191548:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788521704.191558:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816885760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521704.191585:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521704.191614:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816885632 00000100:00100000:3.0:1788521704.191618:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816885632 00010000:00010000:3.0:1788521704.191636:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996f8149cc00/0x1b7b50db5927ba80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927ba79 expref: 18 pid: 5826 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521704.191657:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816885760 00000100:00100000:3.0:1788521704.191660:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816885760 00010000:00010000:3.0:1788521704.191671:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996f829d5a00/0x1b7b50db5927ba1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927ba17 expref: 19 pid: 5827 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521704.191688:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788521704.191695:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3304:x1875400816885632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788521704.191703:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521704.191708:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996f8149cc00/0x1b7b50db5927ba80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927ba79 expref: 19 pid: 5826 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521704.191729:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996f8149cc00/0x1b7b50db5927ba80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927ba79 expref: 19 pid: 5826 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521704.191742:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8149cc00/0x1b7b50db5927ba80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927ba79 expref: 19 pid: 5826 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521704.191752:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521704.191784:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:3304:x1875400816885632:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521704.191791:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788521704.191807:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788521704.191814:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:3304:x1875400816885760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788521704.191823:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521704.191828:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996f829d5a00/0x1b7b50db5927ba1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927ba17 expref: 17 pid: 5827 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521704.191837:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996f829d5a00/0x1b7b50db5927ba1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927ba17 expref: 17 pid: 5827 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521704.191847:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f829d5a00/0x1b7b50db5927ba1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927ba17 expref: 17 pid: 5827 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521704.191856:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521704.191876:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:3304:x1875400816885760:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521704.191882:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788521704.191920:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816885504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521704.191949:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816885760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521704.191963:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816885632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521704.201848:0:8506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875400816884992:192.168.206.48@tcp:104: 00010000:00010000:0.0:1788521704.201892:0:8506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996f829d4400/0x1b7b50db5927bca9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521704.204708:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521704.204922:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799032448 00000100:00100000:0.0:1788521704.204933:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799032448 00010000:00010000:0.0:1788521704.204975:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996f8149c400/0x1b7b50db5927bc08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0087b expref: 10 pid: 5826 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521704.205057:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 24 00000100:00100000:0.0:1788521704.205069:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8401310-f5ba-4cf2-b118-0866831b1010+10:2363:x1875400799032448:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521704.205094:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521704.205100:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996f8149c400/0x1b7b50db5927bc08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0087b expref: 10 pid: 5826 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521704.205118:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996f8149c400/0x1b7b50db5927bc08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0087b expref: 10 pid: 5826 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521704.205135:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8149c400/0x1b7b50db5927bc08 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0087b expref: 10 pid: 5826 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521704.205183:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996f829d4400/0x1b7b50db5927bca9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521704.205207:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f829d4400/0x1b7b50db5927bca9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521704.205224:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996f829d4400/0x1b7b50db5927bca9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521704.205231:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996f829d4400/0x1b7b50db5927bca9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521704.205238:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996f829d4400/0x1b7b50db5927bca9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521704.205245:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996f829d4400/0x1b7b50db5927bca9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521704.205250:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d4400 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521704.205255:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996f829d4400/0x1b7b50db5927bca9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521704.205263:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996f829d4400/0x1b7b50db5927bca9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521704.205276:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996f829d4400/0x1b7b50db5927bca9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521704.205287:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521704.205334:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8401310-f5ba-4cf2-b118-0866831b1010+9:2363:x1875400799032448:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 268us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521704.205341:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 24 00010000:00010000:1.0:1788521704.205414:0:8506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996f829d4400/0x1b7b50db5927bca9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521704.205423:0:8506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996f829d4400/0x1b7b50db5927bca9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521704.205429:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f829d4400/0x1b7b50db5927bca9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521704.248126:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521704.252467:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799032576 00000100:00100000:3.0:1788521704.252482:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799032576 00000100:00100000:3.0:1788521704.252547:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 169 00000100:00100000:3.0:1788521704.252557:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+9:5600:x1875400799032576:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521704.252573:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521704.252590:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bcb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe705d7355cd008ba expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521704.252615:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bcb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008ba expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521704.252626:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bcb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008ba expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521704.252634:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392c800, rc 0) 00000100:00100000:3.0:1788521704.253867:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+10:5600:x1875400799032576:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 Request processed in 1304us (5750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521704.253877:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 169 00000100:00100000:3.0:1788521704.260861:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521704.260965:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799032704 00000100:00100000:0.0:1788521704.260986:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799032704 00000100:00100000:0.0:1788521704.261042:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 170 00000100:00100000:0.0:1788521704.261052:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+10:5600:x1875400799032704:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521704.261339:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+10:5600:x1875400799032704:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 Request processed in 287us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521704.261359:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 170 00000100:00100000:1.0:1788521704.271419:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521704.271452:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799032832 00000100:00100000:1.0:1788521704.271461:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799032832 00000100:00100000:1.0:1788521704.271504:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 171 00000100:00100000:1.0:1788521704.271668:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+10:5600:x1875400799032832:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521704.271890:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+10:5600:x1875400799032832:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 Request processed in 377us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521704.271898:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 171 00000100:00100000:1.0:1788521704.282566:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521704.282638:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799032960 00000100:00100000:3.0:1788521704.282648:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799032960 00000100:00100000:3.0:1788521704.282698:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 172 00000100:00100000:3.0:1788521704.282708:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+10:6091:x1875400799032960:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788521704.283027:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+10:6091:x1875400799032960:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 319us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521704.283044:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 172 00000100:00100000:3.0:1788521704.287006:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521704.287130:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799033088 00000100:00100000:1.0:1788521704.287180:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799033088 00000100:00100000:1.0:1788521704.287226:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 173 00000100:00100000:1.0:1788521704.287235:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+10:6091:x1875400799033088:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788521704.287435:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+10:6091:x1875400799033088:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 201us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521704.287443:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 173 00010000:00010000:3.0:1788521704.593650:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521704.719499:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521704.719741:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799033344 00000100:00100000:0.0:1788521704.719754:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799033344 00000100:00100000:0.0:1788521704.719846:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:0.0:1788521704.719858:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2364:x1875400799033344:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521704.719946:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2364:x1875400799033344:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 89us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521704.719955:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:1.0:1788521704.720304:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521704.720342:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521704.720366:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799033216 00000100:00100000:1.0:1788521704.720376:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799033216 00000100:00100000:1.0:1788521704.720417:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 26 00000100:00100000:1.0:1788521704.720425:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2364:x1875400799033216:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521704.720460:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2364:x1875400799033216:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 37us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521704.720467:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 26 00000100:00100000:1.0:1788521704.720486:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799033472 00000100:00100000:1.0:1788521704.720489:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799033472 00000100:00100000:1.0:1788521704.720511:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:1.0:1788521704.720517:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2364:x1875400799033472:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521704.720709:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2364:x1875400799033472:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 190us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521704.720716:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00080000:2.0:1788521704.720829:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521704.720836:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788521704.720838:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788521705.615782:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788521705.678234:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788521705.678241:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff996f86ac1800 from 4 10000000:01000000:1.0:1788521705.678246:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788521705.678311:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5600/0x1b7b50db5927bcb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521705.678323:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5600/0x1b7b50db5927bcb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521705.678334:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5600/0x1b7b50db5927bcb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521705.678357:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816885888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788521705.678414:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521705.678469:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cb780 going to sleep for 11 seconds 00000100:00100000:3.0:1788521705.678503:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816885888 00000100:00100000:3.0:1788521705.678511:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816885888 00000100:00100000:3.0:1788521705.678560:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788521705.678569:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:5830:x1875400816885888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521705.678580:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521705.678592:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f8392de00/0x1b7b50db5927bcbe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927bcb7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521705.678734:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8392de00/0x1b7b50db5927bcbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927bcb7 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521705.678746:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f8392de00/0x1b7b50db5927bcbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bcb7 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521705.678755:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392de00, rc 0) 00000100:00100000:1.0:1788521705.678972:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816885888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521705.678993:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5600/0x1b7b50db5927bcb7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bcbe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521705.679002:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5600/0x1b7b50db5927bcb7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bcbe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521705.679054:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816886016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521705.679088:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521705.679108:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cb780 going to sleep for 11 seconds 00000100:00100000:3.0:1788521705.679519:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:5830:x1875400816885888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 950us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521705.679528:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788521705.679904:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816886016 00000100:00100000:0.0:1788521705.679910:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816886016 00000100:00100000:0.0:1788521705.679955:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788521705.679964:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:5830:x1875400816886016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521705.680348:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:5830:x1875400816886016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 385us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521705.680355:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788521705.680545:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816886016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521705.680589:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a8bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816886144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521705.680637:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521705.680664:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fad804240 going to sleep for 11 seconds 00000100:00100000:2.0:1788521705.680762:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816886144 00000100:00100000:2.0:1788521705.680768:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816886144 00000100:00100000:2.0:1788521705.680872:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788521705.680881:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:5830:x1875400816886144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521705.681033:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:5830:x1875400816886144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521705.681041:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788521705.681069:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a8bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816886144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521705.682736:0:8585:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8585:1875400816886272:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521705.682819:0:8585:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521705.682856:0:8585:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cb180 going to sleep for 11 seconds 00000100:00100000:0.0:1788521705.682902:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816886272 00000100:00100000:0.0:1788521705.682909:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816886272 00000100:00100000:0.0:1788521705.682955:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788521705.682964:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:8585:x1875400816886272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521705.683199:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:8585:x1875400816886272:12345-0@lo:502:llog_process_th.0 Request processed in 235us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521705.683216:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788521705.683234:0:8585:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8585:1875400816886272:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788521705.683266:0:8585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521705.683276:0:8585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521705.683278:0:8585:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788521705.683288:0:8585:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff996f86ac1800 00000020:00000080:3.0:1788521705.683291:0:8585:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788521705.683356:0:8585:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a8bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8585:1875400816886400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521705.683392:0:8585:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521705.683471:0:8585:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fad804240 going to sleep for 11 seconds 00000100:00100000:1.0:1788521705.683515:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816886400 00000100:00100000:1.0:1788521705.683520:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816886400 00000100:00100000:1.0:1788521705.683593:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788521705.683602:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:8585:x1875400816886400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521705.683754:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:8585:x1875400816886400:12345-0@lo:502:llog_process_th.0 Request processed in 153us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521705.683761:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788521705.683890:0:8585:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a8bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8585:1875400816886400:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788521705.683911:0:8585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521705.686061:0:8585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521705.686068:0:8585:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788521705.686076:0:8585:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788521705.686485:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788521705.686508:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788521705.686519:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5600/0x1b7b50db5927bcb7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bcbe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521705.686531:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5600/0x1b7b50db5927bcb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bcbe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521705.686541:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788521705.686543:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff996f97fff000 from 4 10000000:01000000:3.0:1788521705.686546:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788521705.686578:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392c000/0x1b7b50db5927bcc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521705.686586:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996f8392c000/0x1b7b50db5927bcc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521705.686596:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f8392c000/0x1b7b50db5927bcc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521705.686642:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816886528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788521705.686703:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521705.686741:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fad804d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521705.687029:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816886528 00000100:00100000:1.0:1788521705.687037:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816886528 00000100:00100000:1.0:1788521705.687091:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788521705.687100:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:5830:x1875400816886528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521705.687740:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521705.688260:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996fbc6d4400/0x1b7b50db5927bccc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927bcc5 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521705.688741:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fbc6d4400/0x1b7b50db5927bccc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927bcc5 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521705.689335:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996fbc6d4400/0x1b7b50db5927bccc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bcc5 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521705.689345:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d4400, rc 0) 00000100:00100000:1.0:1788521705.689419:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:5830:x1875400816886528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2319us (2715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521705.689427:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788521705.689859:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816886528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521705.689880:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f8392c000/0x1b7b50db5927bcc5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bccc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521705.689891:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f8392c000/0x1b7b50db5927bcc5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bccc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521705.689958:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816886656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521705.689994:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521705.690029:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f91285b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788521705.690342:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816886656 00000100:00100000:1.0:1788521705.690348:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816886656 00000100:00100000:1.0:1788521705.690393:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788521705.690401:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:5830:x1875400816886656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521705.691050:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:5830:x1875400816886656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 648us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521705.691066:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788521705.691129:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816886656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521705.691192:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816886784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521705.691238:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521705.691275:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f91285b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788521705.691325:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816886784 00000100:00100000:1.0:1788521705.691330:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816886784 00000100:00100000:1.0:1788521705.691394:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788521705.691403:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:5830:x1875400816886784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521705.691547:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:5830:x1875400816886784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521705.691555:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788521705.693267:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816886784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521705.694937:0:8588:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8588:1875400816886912:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521705.695074:0:8588:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521705.695126:0:8588:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f91285900 going to sleep for 11 seconds 00000100:00100000:1.0:1788521705.695464:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816886912 00000100:00100000:1.0:1788521705.695471:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816886912 00000100:00100000:1.0:1788521705.695517:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788521705.695527:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:8588:x1875400816886912:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521705.696034:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:8588:x1875400816886912:12345-0@lo:502:llog_process_th.0 Request processed in 506us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521705.696043:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788521705.696314:0:8588:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8588:1875400816886912:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788521705.696347:0:8588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521705.696356:0:8588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521705.696358:0:8588:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788521705.696366:0:8588:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff996f97fff000 00000020:00000080:2.0:1788521705.696369:0:8588:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788521705.696459:0:8588:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8588:1875400816887040:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521705.696502:0:8588:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521705.696941:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816887040 00000100:00100000:1.0:1788521705.696956:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816887040 00000100:00100000:1.0:1788521705.696991:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788521705.697000:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:8588:x1875400816887040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521705.697187:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:8588:x1875400816887040:12345-0@lo:502:llog_process_th.0 Request processed in 188us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521705.697195:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788521705.697456:0:8588:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f91285900 going to sleep for 11 seconds 00000100:00100000:2.0:1788521705.697476:0:8588:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8588:1875400816887040:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788521705.697505:0:8588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521705.697511:0:8588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521705.697513:0:8588:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788521705.697517:0:8588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788521705.698131:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788521705.698379:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788521705.698390:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392c000/0x1b7b50db5927bcc5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bccc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521705.698401:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996f8392c000/0x1b7b50db5927bcc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bccc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521705.698412:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788521705.698415:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff996f85616000 from 4 10000000:01000000:0.0:1788521705.698418:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788521705.698450:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927bcd3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521705.698457:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927bcd3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521705.698467:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927bcd3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521705.698486:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc6fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816887168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788521705.698913:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521705.698960:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f91c7a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788521705.699167:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816887168 00000100:00100000:2.0:1788521705.699175:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816887168 00000100:00100000:2.0:1788521705.699216:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788521705.699294:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:5830:x1875400816887168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521705.699307:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521705.699321:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996fb490b400/0x1b7b50db5927bcda lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927bcd3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521705.699356:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fb490b400/0x1b7b50db5927bcda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927bcd3 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521705.699366:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996fb490b400/0x1b7b50db5927bcda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bcd3 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521705.699376:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490b400, rc 0) 00000100:00100000:2.0:1788521705.699468:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:5830:x1875400816887168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521705.699475:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788521705.699716:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc6fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816887168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521705.699733:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927bcd3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bcda expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521705.699742:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927bcd3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bcda expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521705.699801:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc6fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816887296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521705.699831:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521705.699864:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f91c7a240 going to sleep for 11 seconds 00000100:00100000:1.0:1788521705.699877:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816887296 00000100:00100000:1.0:1788521705.699883:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816887296 00000100:00100000:1.0:1788521705.699959:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788521705.699968:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:5830:x1875400816887296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521705.700230:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:5830:x1875400816887296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521705.700238:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788521705.700330:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc6fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816887296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521705.700364:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc6fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816887424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521705.700409:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521705.703861:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f91c7a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788521705.705502:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816887424 00000100:00100000:2.0:1788521705.705514:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816887424 00000100:00100000:2.0:1788521705.705558:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788521705.705567:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:5830:x1875400816887424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521705.705780:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:5830:x1875400816887424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 212us (5369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521705.705956:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788521705.706092:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc6fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816887424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521705.706309:0:8590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8590:1875400816887552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521705.706550:0:8590:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521705.706577:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816887552 00000100:00100000:2.0:1788521705.706581:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816887552 00000100:00100000:2.0:1788521705.706603:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788521705.706610:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:8590:x1875400816887552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521705.706876:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:8590:x1875400816887552:12345-0@lo:502:llog_process_th.0 Request processed in 265us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521705.706889:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788521705.706930:0:8590:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f91285f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788521705.706944:0:8590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8590:1875400816887552:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788521705.706968:0:8590:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521705.706976:0:8590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521705.706978:0:8590:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788521705.706984:0:8590:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff996f85616000 00000020:00000080:2.0:1788521705.706987:0:8590:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788521705.707057:0:8590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8590:1875400816887680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521705.707883:0:8590:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521705.707909:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816887680 00000100:00100000:2.0:1788521705.707914:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816887680 00000100:00100000:2.0:1788521705.707938:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788521705.707946:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:8590:x1875400816887680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521705.708881:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:8590:x1875400816887680:12345-0@lo:502:llog_process_th.0 Request processed in 161us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521705.708894:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788521705.708952:0:8590:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f91285f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788521705.708974:0:8590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:8590:1875400816887680:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788521705.709007:0:8590:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521705.709014:0:8590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521705.709017:0:8590:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788521705.709022:0:8590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788521705.709091:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788521705.709367:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788521705.709377:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927bcd3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bcda expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521705.709393:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927bcd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bcda expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521706.638635:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521706.831102:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816887808:0@lo:400:kworker.0 00000100:00100000:3.0:1788521706.831190:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521706.831276:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816887808 00000100:00100000:0.0:1788521706.831283:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816887808 00000100:00100000:0.0:1788521706.831327:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788521706.831336:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3306:x1875400816887808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521706.831634:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3306:x1875400816887808:12345-0@lo:400:kworker.0 Request processed in 298us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521706.831641:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788521706.831685:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875400816887936:0@lo:400:kworker.0 00000100:00100000:0.0:1788521706.831714:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521706.831746:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816887936 00000100:00100000:0.0:1788521706.831751:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816887936 00000100:00100000:0.0:1788521706.831777:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788521706.833591:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816887808:0@lo:400:kworker.0 00000100:00100000:0.0:1788521706.834290:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc6ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875400816887936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521706.834366:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc6ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875400816887936:12345-0@lo:400:kworker.0 Request processed in 86us (2651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521706.834375:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788521706.834495:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875400816887936:0@lo:400:kworker.0 00000100:00100000:3.0:1788521706.835717:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875400816888064:0@lo:400:kworker.0 00000100:00100000:3.0:1788521706.835769:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521706.835892:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816888064 00000100:00100000:0.0:1788521706.835899:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816888064 00000100:00100000:0.0:1788521706.835962:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788521706.835972:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875400816888064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521706.838091:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875400816888064:12345-0@lo:400:kworker.0 Request processed in 2103us (2304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521706.838103:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788521706.838160:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521706.838409:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875400816888064:0@lo:400:kworker.0 00000100:00100000:3.0:1788521706.838429:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788521706.838438:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816888192:0@lo:400:kworker.0 00000100:00100000:3.0:1788521706.838598:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521706.838704:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816888192 00000100:00100000:0.0:1788521706.838709:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816888192 00000100:00100000:0.0:1788521706.838763:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788521706.838772:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816888192:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788521706.839007:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521706.839122:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816888192:12345-0@lo:400:kworker.0 Request processed in 351us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521706.839129:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788521706.839347:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816888448:0@lo:400:kworker.0 00000100:00100000:2.0:1788521706.839378:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521706.839401:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788521706.839406:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875400816888320:0@lo:400:kworker.0 00000100:00100000:2.0:1788521706.839430:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521706.839452:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816888448 00000100:00100000:2.0:1788521706.839464:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816888448 00000100:00100000:2.0:1788521706.839494:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788521706.839501:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbcb31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816888448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521706.839544:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbcb31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816888448:12345-0@lo:400:kworker.0 Request processed in 43us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521706.839550:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788521706.839578:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fbcb30700 x1875400816888448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521706.839590:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816888448:0@lo:400:kworker.0 00000100:00080000:2.0:1788521706.839610:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788521706.839768:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816888320 00000100:00100000:0.0:1788521706.839773:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816888320 00000100:00100000:0.0:1788521706.839915:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788521706.839922:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbcb30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875400816888320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521706.840031:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbcb30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875400816888320:12345-0@lo:400:kworker.0 Request processed in 110us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521706.840038:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788521706.840065:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875400816888320:0@lo:400:kworker.0 00000100:00080000:2.0:1788521706.840158:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788521706.840278:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fbcb30e00 x1875400816888192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521706.840290:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816888192:0@lo:400:kworker.0 00000100:00100000:1.0:1788521707.342382:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788521707.342402:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816888576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521707.342467:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521707.342529:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816888576 00000100:00100000:1.0:1788521707.342535:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816888576 00000100:00100000:1.0:1788521707.342579:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788521707.342587:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816888576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521707.342620:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521707.342662:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816888576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521707.342669:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788521707.342708:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fbfc2e680 x1875400816888576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521723 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521707.342726:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816888576:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788521707.671882:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521708.686297:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521708.879367:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788521708.879390:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816888704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521708.879456:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521708.879673:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816888704 00000100:00100000:2.0:1788521708.879680:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816888704 00000100:00080000:0.0:1788521708.879738:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521708.879755:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788521708.879764:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc6ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816888704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788521708.879796:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521708.879857:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc6ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816888704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521708.879863:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788521708.879980:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fbcb30700 x1875400816888704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521708.880000:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816888704:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788521709.535642:0:8806:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1788521709.710420:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521709.835406:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521709.835501:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521709.835538:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521709.835564:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521709.835592:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799033984 00000100:00100000:1.0:1788521709.835601:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799033984 00000100:00100000:1.0:1788521709.835683:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799033856 00000100:00100000:1.0:1788521709.835686:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799033856 00000100:00100000:1.0:1788521709.835721:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:1.0:1788521709.835730:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2363:x1875400799033984:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521709.835795:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2363:x1875400799033984:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 67us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521709.835803:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:1.0:1788521709.835818:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:1.0:1788521709.835824:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2364:x1875400799033856:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521709.835864:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2364:x1875400799033856:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 40us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521709.835871:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00080000:1.0:1788521709.835956:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788521709.835959:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521709.837619:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799033600 00000100:00100000:2.0:1788521709.837631:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799033600 00000100:00100000:2.0:1788521709.837846:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 190 00000100:00100000:3.0:1788521709.838671:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799033728 00000100:00100000:3.0:1788521709.838680:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799033728 00000100:00100000:3.0:1788521709.838748:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 30 00000100:00100000:3.0:1788521709.838770:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2363:x1875400799033728:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521709.838984:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+10:2364:x1875400799033600:12345-192.168.206.48@tcp:400:kworker.0 00000100:00080000:1.0:1788521709.839032:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521709.839106:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2363:x1875400799033728:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 336us (3603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521709.839115:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 30 00000100:00100000:2.0:1788521709.839475:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+10:2364:x1875400799033600:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 1619us (4076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521709.839490:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 190 00010000:00010000:3.0:1788521710.734435:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521711.760517:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521711.950375:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875400816888960:0@lo:400:kworker.0 00000100:00100000:1.0:1788521711.950451:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521711.950514:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816889472:0@lo:400:kworker.0 00000100:00100000:1.0:1788521711.950540:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521711.950569:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788521711.950575:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816888832:0@lo:400:kworker.0 00000100:00100000:1.0:1788521711.950602:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521711.950624:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875400816889344:0@lo:400:kworker.0 00000100:00100000:1.0:1788521711.950648:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521711.950675:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875400816889088:0@lo:400:kworker.0 00000100:00100000:1.0:1788521711.950695:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521711.950712:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788521711.950729:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816889216:0@lo:400:kworker.0 00000100:00100000:1.0:1788521711.950764:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521711.950798:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816888960 00000100:00100000:1.0:1788521711.950805:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816888960 00000100:00100000:1.0:1788521711.950838:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816889344 00000100:00100000:1.0:1788521711.950842:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816889344 00000100:00100000:1.0:1788521711.950877:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816889088 00000100:00100000:1.0:1788521711.950881:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816889088 00000100:00100000:1.0:1788521711.950900:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788521711.950908:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875400816888960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521711.950957:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875400816888960:12345-0@lo:400:kworker.0 Request processed in 49us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521711.950965:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788521711.950980:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788521711.950986:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875400816889344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521711.951013:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875400816889344:12345-0@lo:400:kworker.0 Request processed in 27us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521711.951019:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788521711.951030:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788521711.951035:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875400816889088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521711.951077:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875400816889088:12345-0@lo:400:kworker.0 Request processed in 42us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521711.951083:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788521711.951101:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816889472 00000100:00100000:1.0:1788521711.951105:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816889472 00000100:00100000:1.0:1788521711.951130:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816889216 00000100:00100000:1.0:1788521711.951133:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816889216 00000100:00100000:1.0:1788521711.951173:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788521711.951187:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816889472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521711.951217:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816889472:12345-0@lo:400:kworker.0 Request processed in 32us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521711.951223:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788521711.951236:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788521711.951242:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816889216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521711.951267:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816889216:12345-0@lo:400:kworker.0 Request processed in 26us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521711.951272:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788521711.951288:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816888832 00000100:00100000:1.0:1788521711.951292:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816888832 00000100:00100000:1.0:1788521711.951317:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788521711.951322:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3307:x1875400816888832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521711.951348:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3307:x1875400816888832:12345-0@lo:400:kworker.0 Request processed in 26us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521711.951353:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00080000:1.0:1788521711.951384:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788521711.951387:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788521711.951390:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788521711.951417:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fbfc2ca80 x1875400816889216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521711.951431:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816889216:0@lo:400:kworker.0 00000100:00100000:1.0:1788521711.951442:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875400816889088:0@lo:400:kworker.0 00000100:00100000:1.0:1788521711.951476:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816888832:0@lo:400:kworker.0 00000100:00100000:1.0:1788521711.951484:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875400816889344:0@lo:400:kworker.0 00000100:00100000:1.0:1788521711.951503:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875400816888960:0@lo:400:kworker.0 00010000:00080000:1.0:1788521711.951512:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fbfc2fb80 x1875400816889472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521711.951519:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816889472:0@lo:400:kworker.0 00000100:00100000:2.0:1788521712.464670:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788521712.464691:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816889600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521712.464753:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521712.465090:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816889600 00000100:00100000:3.0:1788521712.465098:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816889600 00000100:00100000:3.0:1788521712.465185:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788521712.465194:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbcb33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816889600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788521712.465226:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521712.465270:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbcb33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816889600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521712.465277:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788521712.465419:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb7a8aa00 x1875400816889600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521728 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521712.465436:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816889600:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788521712.783287:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788521713.805943:0:9050:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing yml_node 00010000:00010000:3.0:1788521713.809752:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521713.998890:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816889728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521713.998957:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521713.999022:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816889728 00000100:00100000:3.0:1788521713.999029:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816889728 00000100:00100000:2.0:1788521713.999254:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788521713.999266:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816889728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788521713.999298:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521713.999349:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816889728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521713.999370:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788521713.999409:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fbcb31880 x1875400816889728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521713.999438:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816889728:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788521713.999473:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788521714.832431:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521714.958055:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521714.958102:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521714.958140:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521714.958213:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521714.958242:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799034368 00000100:00100000:1.0:1788521714.958250:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799034368 00000100:00100000:1.0:1788521714.958303:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799034496 00000100:00100000:1.0:1788521714.958306:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799034496 00000100:00100000:1.0:1788521714.958325:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:1.0:1788521714.958334:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2362:x1875400799034368:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521714.958395:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2362:x1875400799034368:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 62us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521714.958403:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:1.0:1788521714.958418:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:1.0:1788521714.958425:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2362:x1875400799034496:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521714.958448:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2362:x1875400799034496:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 23us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521714.958454:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:0.0:1788521714.958624:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799034240 00000100:00100000:0.0:1788521714.958629:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799034240 00000100:00100000:0.0:1788521714.958663:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 34 00000100:00100000:0.0:1788521714.958670:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2362:x1875400799034240:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521714.958699:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2362:x1875400799034240:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 29us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521714.958705:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 34 00000100:00100000:3.0:1788521714.959090:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799034112 00000100:00100000:3.0:1788521714.959095:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799034112 00000100:00100000:3.0:1788521714.959133:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 192 00000100:00100000:3.0:1788521714.959168:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86014c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+10:2362:x1875400799034112:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521714.959202:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86014c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+10:2362:x1875400799034112:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 62us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521714.959208:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 192 00000100:00080000:1.0:1788521714.959906:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788521714.959914:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788521714.959923:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788521715.858399:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521716.878356:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521717.070425:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875400816889984:0@lo:400:kworker.0 00000100:00100000:3.0:1788521717.070491:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521717.070552:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816890496:0@lo:400:kworker.0 00000100:00100000:3.0:1788521717.070582:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521717.070613:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788521717.070619:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816889856:0@lo:400:kworker.0 00000100:00100000:3.0:1788521717.070658:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521717.070681:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875400816890368:0@lo:400:kworker.0 00000100:00100000:3.0:1788521717.070703:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521717.070730:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816890496 00000100:00100000:3.0:1788521717.070737:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816890496 00000100:00100000:3.0:1788521717.070788:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788521717.070796:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816890496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521717.070857:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816890496:12345-0@lo:400:kworker.0 Request processed in 49us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521717.070865:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788521717.070887:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816889856 00000100:00100000:3.0:1788521717.070890:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816889856 00000100:00100000:3.0:1788521717.070914:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788521717.070920:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3307:x1875400816889856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521717.070949:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3307:x1875400816889856:12345-0@lo:400:kworker.0 Request processed in 29us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521717.070955:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:3.0:1788521717.070978:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788521717.071004:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816889856:0@lo:400:kworker.0 00010000:00080000:3.0:1788521717.071051:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996e82705180 x1875400816890496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521717.071062:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816890496:0@lo:400:kworker.0 00000100:00100000:3.0:1788521717.071110:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816890240:0@lo:400:kworker.0 00000100:00100000:3.0:1788521717.071135:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521717.071183:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788521717.071188:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875400816890112:0@lo:400:kworker.0 00000100:00100000:3.0:1788521717.071209:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521717.071231:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816890240 00000100:00100000:3.0:1788521717.071235:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816890240 00000100:00100000:3.0:1788521717.071262:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788521717.071268:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816890240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521717.071302:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816890240:12345-0@lo:400:kworker.0 Request processed in 34us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521717.071308:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788521717.071321:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788521717.071335:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996e82705c00 x1875400816890240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521717.071344:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816890240:0@lo:400:kworker.0 00000100:00100000:1.0:1788521717.071486:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816889984 00000100:00100000:1.0:1788521717.071491:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816889984 00000100:00100000:1.0:1788521717.071512:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816890368 00000100:00100000:1.0:1788521717.071514:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816890368 00000100:00100000:1.0:1788521717.071536:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816890112 00000100:00100000:1.0:1788521717.071539:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816890112 00000100:00100000:1.0:1788521717.071554:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788521717.071561:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875400816889984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521717.071601:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875400816889984:12345-0@lo:400:kworker.0 Request processed in 40us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521717.071607:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788521717.071621:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788521717.071628:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875400816890368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521717.071667:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875400816890368:12345-0@lo:400:kworker.0 Request processed in 39us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521717.071673:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788521717.071686:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788521717.071693:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875400816890112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521717.071727:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875400816890112:12345-0@lo:400:kworker.0 Request processed in 35us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521717.071733:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788521717.072756:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521717.072792:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875400816890112:0@lo:400:kworker.0 00000100:00100000:3.0:1788521717.072827:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875400816890368:0@lo:400:kworker.0 00000100:00100000:3.0:1788521717.072837:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875400816889984:0@lo:400:kworker.0 00000001:02000400:0.0:1788521717.456583:0:9242:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00000100:00100000:3.0:1788521717.583797:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816890624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521717.583867:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521717.583944:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816890624 00000100:00100000:3.0:1788521717.583951:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816890624 00000100:00100000:3.0:1788521717.584001:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788521717.584012:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816890624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788521717.584056:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521717.584100:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816890624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521717.584106:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788521717.585741:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb7a89500 x1875400816890624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521733 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521717.585774:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816890624:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788521717.902920:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521718.926685:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521719.118572:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788521719.118595:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816890752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521719.118668:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521719.118843:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816890752 00000100:00100000:3.0:1788521719.118852:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816890752 00000100:00100000:3.0:1788521719.118998:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788521719.119020:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc6fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816890752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788521719.119055:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521719.119114:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc6fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816890752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521719.119121:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788521719.119193:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fbcb31880 x1875400816890752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521735 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521719.119214:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816890752:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788521719.119303:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1788521719.853541:0:9339:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00010000:00010000:3.0:1788521719.954739:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521720.087414:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521720.087467:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521720.087979:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799034752 00000100:00100000:3.0:1788521720.087993:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799034752 00000100:00100000:3.0:1788521720.088103:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 38 00000100:00100000:0.0:1788521720.088103:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799034624 00000100:00100000:0.0:1788521720.088115:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799034624 00000100:00100000:3.0:1788521720.088124:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbcb32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2364:x1875400799034752:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521720.088204:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 194 00000100:00100000:0.0:1788521720.088218:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+10:2364:x1875400799034624:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521720.088253:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbcb32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2364:x1875400799034752:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 135us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521720.088263:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 38 00000100:00100000:0.0:1788521720.088282:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+10:2364:x1875400799034624:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 65us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521720.088306:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 194 00000100:00080000:2.0:1788521720.088472:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521720.097793:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521720.097844:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521720.097873:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799034880 00000100:00100000:3.0:1788521720.097882:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799034880 00000100:00100000:3.0:1788521720.098045:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799035008 00000100:00100000:3.0:1788521720.098050:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799035008 00000100:00100000:3.0:1788521720.098077:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:3.0:1788521720.098087:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2360:x1875400799034880:12345-192.168.206.48@tcp:9:kworker.0 00000020:00000080:3.0:1788521720.098119:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927bc16 00000100:00080000:3.0:1788521720.098128:0:6687:0:(import.c:65:import_set_state_nolock()) ffff996f87cac800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788521720.098189:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:1.0:1788521720.098657:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788521720.098661:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521720.098697:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+2:2360:x1875400799034880:12345-192.168.206.48@tcp:9:kworker.0 Request processed in 610us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521720.098716:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:3.0:1788521720.098736:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:3.0:1788521720.098744:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2360:x1875400799035008:12345-192.168.206.48@tcp:9:kworker.0 00000020:00000080:3.0:1788521720.098992:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927bc1d 00000100:00080000:3.0:1788521720.099305:0:6687:0:(import.c:65:import_set_state_nolock()) ffff996f87caf000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788521720.099343:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788521720.099596:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+2:2360:x1875400799035008:12345-192.168.206.48@tcp:9:kworker.0 Request processed in 851us (1749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521720.099603:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 11 00010000:00010000:1.0:1788521720.099642:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521720.099690:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521720.974378:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788521721.720840:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4bd13e8f-aac9-42ad-8625-a542705d6920 00000020:00000080:0.0:1788521721.720850:0:6713:0:(genops.c:885:class_export_put()) final put ffff996f87caa800/4bd13e8f-aac9-42ad-8625-a542705d6920 00000020:00000080:3.0:1788521721.720975:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff996f87caa800/4bd13e8f-aac9-42ad-8625-a542705d6920 for lustre-OST0000 00000020:00000080:3.0:1788521721.721131:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff996f87cac800 for lustre-OST0000 00010000:00010000:1.0:1788521721.998829:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521722.199182:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788521722.199359:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875400816891008:0@lo:400:kworker.0 00000100:00100000:3.0:1788521722.199428:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521722.199495:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816890880:0@lo:400:kworker.0 00000100:00100000:3.0:1788521722.199526:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521722.199670:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816890880 00000100:00100000:1.0:1788521722.199677:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816890880 00000100:00100000:1.0:1788521722.199729:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788521722.199740:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3307:x1875400816890880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521722.199791:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3307:x1875400816890880:12345-0@lo:400:kworker.0 Request processed in 54us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521722.199798:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788521722.199883:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816890880:0@lo:400:kworker.0 00000100:00100000:0.0:1788521722.199939:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816891008 00000100:00100000:0.0:1788521722.199944:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816891008 00000100:00100000:0.0:1788521722.199983:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788521722.200067:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875400816891008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521722.200247:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875400816891008:12345-0@lo:400:kworker.0 Request processed in 256us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521722.200254:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788521722.200601:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788521722.200899:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875400816891008:0@lo:400:kworker.0 00000100:00100000:3.0:1788521722.200956:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816891264:0@lo:400:kworker.0 00000100:00100000:3.0:1788521722.201005:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521722.201035:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875400816891136:0@lo:400:kworker.0 00000100:00100000:3.0:1788521722.201056:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521722.201243:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816891264 00000100:00100000:0.0:1788521722.201248:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816891264 00000100:00100000:0.0:1788521722.201295:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788521722.201304:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816891264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521722.201340:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816891264:12345-0@lo:400:kworker.0 Request processed in 38us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521722.201345:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788521722.201424:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788521722.201457:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fbcb30e00 x1875400816891264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521722.201468:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816891264:0@lo:400:kworker.0 00000100:00100000:0.0:1788521722.202064:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875400816891392:0@lo:400:kworker.0 00000100:00100000:0.0:1788521722.202099:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521722.203201:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521722.203212:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816891520:0@lo:400:kworker.0 00000100:00100000:0.0:1788521722.203247:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521722.203274:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816891520 00000100:00100000:0.0:1788521722.203281:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816891520 00000100:00100000:0.0:1788521722.203324:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788521722.203333:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc6fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816891520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521722.203385:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc6fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816891520:12345-0@lo:400:kworker.0 Request processed in 53us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521722.203391:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788521722.203411:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788521722.203462:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fbcb31500 x1875400816891520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521722.203476:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816891520:0@lo:400:kworker.0 00000100:00100000:1.0:1788521722.207712:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816891136 00000100:00100000:1.0:1788521722.207725:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816891136 00000100:00100000:1.0:1788521722.207807:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816891392 00000100:00100000:1.0:1788521722.207812:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816891392 00000100:00100000:1.0:1788521722.207834:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788521722.207844:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875400816891136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521722.207932:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875400816891136:12345-0@lo:400:kworker.0 Request processed in 90us (6874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521722.207939:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788521722.207954:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788521722.207960:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc6fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875400816891392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521722.208003:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc6fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875400816891392:12345-0@lo:400:kworker.0 Request processed in 32us (5892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521722.208019:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1788521722.208038:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521722.208073:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875400816891392:0@lo:400:kworker.0 00000100:00100000:1.0:1788521722.208107:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875400816891136:0@lo:400:kworker.0 00000001:02000400:0.0:1788521722.232688:0:9437:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00000100:00100000:1.0:1788521722.702375:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788521722.702398:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816891648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521722.702473:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521722.702603:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816891648 00000100:00100000:2.0:1788521722.702611:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816891648 00000100:00100000:2.0:1788521722.702657:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788521722.702667:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82707100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816891648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788521722.702699:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521722.702756:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82707100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816891648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521722.702773:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788521722.702959:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb7a8bb80 x1875400816891648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521738 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521722.702978:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816891648:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788521723.024422:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788521723.780834:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4bd13e8f-aac9-42ad-8625-a542705d6920 00000020:00000080:1.0:1788521723.780843:0:7647:0:(genops.c:885:class_export_put()) final put ffff996f87cad800/4bd13e8f-aac9-42ad-8625-a542705d6920 00000020:00000080:3.0:1788521723.780927:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff996f87cad800/4bd13e8f-aac9-42ad-8625-a542705d6920 for lustre-OST0001 00000020:00000080:3.0:1788521723.781107:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff996f87caf000 for lustre-OST0001 00000001:02000400:0.0:1788521723.881475:0:9486:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 4 07:35:22 EDT 2026 00010000:00010000:3.0:1788521724.052587:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521724.238644:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816891776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788521724.238711:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521724.238794:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816891776 00000100:00100000:2.0:1788521724.238803:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816891776 00000100:00100000:2.0:1788521724.238856:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788521724.238865:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816891776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788521724.238905:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521724.238944:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816891776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521724.238951:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1788521724.239363:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788521724.239390:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fbcb33100 x1875400816891776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521740 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521724.239407:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816891776:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788521725.073612:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521725.210556:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521725.210602:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521725.210663:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799035264 00000100:00100000:2.0:1788521725.210663:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799035136 00000100:00100000:3.0:1788521725.210672:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799035264 00000100:00100000:2.0:1788521725.210672:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799035136 00000100:00100000:2.0:1788521725.210717:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 196 00000100:00100000:3.0:1788521725.210720:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 42 00000100:00100000:3.0:1788521725.210727:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2362:x1875400799035264:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521725.210727:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+10:2362:x1875400799035136:12345-192.168.206.48@tcp:400:kworker.0 00000100:00080000:1.0:1788521725.210792:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521725.210870:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2362:x1875400799035264:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 142us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521725.210890:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 42 00000100:00100000:2.0:1788521725.217804:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+10:2362:x1875400799035136:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 7065us (7243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521725.217824:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 196 00010000:00010000:0.0:1788521726.094326:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521727.118469:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521727.310436:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816892288:0@lo:400:kworker.0 00000100:00100000:3.0:1788521727.310501:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521727.310571:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788521727.310579:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82a60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875400816892032:0@lo:400:kworker.0 00000100:00100000:3.0:1788521727.310584:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875400816892160:0@lo:400:kworker.0 00000100:00100000:3.0:1788521727.310631:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521727.310670:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521727.310720:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816892544:0@lo:400:kworker.0 00000100:00100000:2.0:1788521727.311012:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816892160 00000100:00100000:2.0:1788521727.311021:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816892160 00000100:00100000:2.0:1788521727.311071:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816892032 00000100:00100000:2.0:1788521727.311075:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816892032 00000100:00100000:2.0:1788521727.311103:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788521727.311116:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875400816892160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521727.311126:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521727.311209:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788521727.311220:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816891904:0@lo:400:kworker.0 00000100:00100000:2.0:1788521727.311228:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875400816892160:12345-0@lo:400:kworker.0 Request processed in 113us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521727.311240:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788521727.311266:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788521727.311274:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521727.311283:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc6fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875400816892032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521727.311325:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875400816892416:0@lo:400:kworker.0 00000100:00100000:2.0:1788521727.311339:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc6fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875400816892032:12345-0@lo:400:kworker.0 Request processed in 61us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521727.311348:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788521727.311368:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788521727.311376:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521727.311408:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816892416 00000100:00100000:2.0:1788521727.311413:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816892416 00000100:00100000:0.0:1788521727.311427:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82a60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875400816892032:0@lo:400:kworker.0 00000100:00100000:2.0:1788521727.311451:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788521727.311466:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc6fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875400816892416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521727.311490:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816892288 00000100:00100000:0.0:1788521727.311498:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816892288 00000100:00100000:2.0:1788521727.311521:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc6fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875400816892416:12345-0@lo:400:kworker.0 Request processed in 59us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521727.311530:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788521727.311554:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816892544 00000100:00080000:2.0:1788521727.311555:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521727.311561:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816892544 00000100:00080000:2.0:1788521727.311563:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521727.311606:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788521727.311624:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875400816892160:0@lo:400:kworker.0 00000100:00100000:0.0:1788521727.311654:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816892288:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788521727.311681:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788521727.311723:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816892288:12345-0@lo:400:kworker.0 Request processed in 79us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521727.311736:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788521727.311738:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816891904 00000100:00100000:2.0:1788521727.311745:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816891904 00000100:00100000:0.0:1788521727.311763:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788521727.311775:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc6fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816892544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521727.311790:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788521727.311802:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3307:x1875400816891904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521727.311817:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc6fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816892544:12345-0@lo:400:kworker.0 Request processed in 44us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521727.311825:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788521727.311896:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996f860d8700 x1875400816892288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521727.311909:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816892288:0@lo:400:kworker.0 00000100:00100000:0.0:1788521727.311951:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816891904:0@lo:400:kworker.0 00000100:00100000:0.0:1788521727.311977:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875400816892416:0@lo:400:kworker.0 00010000:00080000:0.0:1788521727.311989:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996f85748380 x1875400816892544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521727.311998:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816892544:0@lo:400:kworker.0 00000100:00100000:2.0:1788521727.313809:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3307:x1875400816891904:12345-0@lo:400:kworker.0 Request processed in 58us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521727.313822:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788521727.822895:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98072a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816892672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521727.822983:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521727.823613:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816892672 00000100:00100000:0.0:1788521727.823622:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816892672 00000100:00100000:0.0:1788521727.823679:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788521727.823689:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbcb30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816892672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788521727.823723:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521727.825680:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbcb30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816892672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1986us (2690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521727.825707:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1788521727.825913:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996f98072a00 x1875400816892672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521743 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521727.826018:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98072a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816892672:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788521728.144100:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521729.167264:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521729.366763:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788521729.366795:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816892800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788521729.366858:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521729.366975:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816892800 00000100:00100000:2.0:1788521729.366984:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816892800 00000100:00100000:3.0:1788521729.367113:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788521729.367126:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816892800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788521729.367175:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521729.367225:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816892800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521729.367232:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788521729.367272:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fbcb32d80 x1875400816892800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521745 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521729.367292:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816892800:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788521729.367324:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788521730.195315:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521730.323743:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521730.323780:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521730.323808:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799035520 00000100:00100000:3.0:1788521730.323817:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799035520 00000100:00100000:3.0:1788521730.323877:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00100000:3.0:1788521730.323886:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2362:x1875400799035520:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521730.323964:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2362:x1875400799035520:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 78us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521730.323982:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00080000:3.0:1788521730.324084:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521730.324509:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799035392 00000100:00100000:2.0:1788521730.324514:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799035392 00000100:00100000:2.0:1788521730.324588:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 198 00000100:00100000:2.0:1788521730.324597:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+10:2362:x1875400799035392:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521730.324634:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+10:2362:x1875400799035392:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 39us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521730.324641:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 198 00010000:00010000:1.0:1788521731.218932:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521732.238271:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521732.430325:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb46d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875400816893184:0@lo:400:kworker.0 00000100:00100000:3.0:1788521732.430398:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521732.430445:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788521732.430451:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb46d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816893312:0@lo:400:kworker.0 00000100:00100000:3.0:1788521732.430473:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521732.430610:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb46d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816892928:0@lo:400:kworker.0 00000100:00100000:0.0:1788521732.430640:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521732.430662:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb46d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875400816893440:0@lo:400:kworker.0 00000100:00100000:0.0:1788521732.430695:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521732.430713:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788521732.430719:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb46d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875400816893056:0@lo:400:kworker.0 00000100:00100000:0.0:1788521732.430739:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521732.430756:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb46d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816893568:0@lo:400:kworker.0 00000100:00100000:0.0:1788521732.430776:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521732.430803:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816893184 00000100:00100000:0.0:1788521732.430809:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816893184 00000100:00100000:0.0:1788521732.430854:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816893440 00000100:00100000:0.0:1788521732.430858:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816893440 00000100:00100000:0.0:1788521732.430871:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816893056 00000100:00100000:0.0:1788521732.430873:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816893056 00000100:00100000:0.0:1788521732.430885:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788521732.430893:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb46d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875400816893184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521732.430951:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb46d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875400816893184:12345-0@lo:400:kworker.0 Request processed in 58us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521732.430958:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788521732.430985:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788521732.430991:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc6ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875400816893440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521732.431023:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc6ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875400816893440:12345-0@lo:400:kworker.0 Request processed in 31us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521732.431035:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788521732.431048:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788521732.431053:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc6fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875400816893056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521732.431080:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc6fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875400816893056:12345-0@lo:400:kworker.0 Request processed in 27us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521732.431085:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788521732.431102:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816893312 00000100:00100000:0.0:1788521732.431105:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816893312 00000100:00100000:0.0:1788521732.431129:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816893568 00000100:00100000:0.0:1788521732.431132:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816893568 00000100:00100000:0.0:1788521732.431170:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788521732.431176:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb46d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816893312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521732.431206:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb46d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816893312:12345-0@lo:400:kworker.0 Request processed in 31us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521732.431212:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788521732.431223:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788521732.431230:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc6fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816893568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521732.431256:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc6fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816893568:12345-0@lo:400:kworker.0 Request processed in 27us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521732.431261:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788521732.431279:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816892928 00000100:00100000:0.0:1788521732.431282:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816892928 00000100:00100000:0.0:1788521732.431304:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788521732.431310:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3306:x1875400816892928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521732.431512:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3306:x1875400816892928:12345-0@lo:400:kworker.0 Request processed in 201us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521732.431527:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:0.0:1788521732.431559:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788521732.431563:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788521732.431565:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788521732.431593:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb46d1180 x1875400816893312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521732.431606:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb46d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816893312:0@lo:400:kworker.0 00000100:00100000:0.0:1788521732.431617:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb46d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875400816893184:0@lo:400:kworker.0 00000100:00100000:0.0:1788521732.431640:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb46d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875400816893056:0@lo:400:kworker.0 00010000:00080000:0.0:1788521732.431648:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb46d3480 x1875400816893568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521732.431656:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb46d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816893568:0@lo:400:kworker.0 00000100:00100000:0.0:1788521732.431910:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb46d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816892928:0@lo:400:kworker.0 00000100:00100000:0.0:1788521732.431921:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb46d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875400816893440:0@lo:400:kworker.0 00000100:00100000:1.0:1788521732.942693:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788521732.942717:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb46d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816893696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521732.942797:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521732.942982:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816893696 00000100:00100000:3.0:1788521732.942992:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816893696 00000100:00100000:3.0:1788521732.943045:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788521732.943055:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816893696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788521732.943088:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521732.943165:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816893696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521732.943172:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788521732.943311:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb46d0e00 x1875400816893696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521748 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521732.943340:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb46d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816893696:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788521733.262478:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521734.287368:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521734.489584:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816893824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521734.489651:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521734.489719:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816893824 00000100:00100000:2.0:1788521734.489725:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816893824 00000100:00100000:2.0:1788521734.489766:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788521734.489773:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbcb31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816893824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788521734.489815:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521734.489850:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbcb31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816893824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521734.489856:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788521734.489890:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fbcb33b80 x1875400816893824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521750 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521734.489907:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816893824:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788521734.490103:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788521735.311718:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521735.434816:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521735.434869:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521735.434873:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799035776 00000100:00100000:1.0:1788521735.434884:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799035776 00000100:00080000:3.0:1788521735.434942:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521735.434967:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 50 00000100:00100000:1.0:1788521735.434979:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb46d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2361:x1875400799035776:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521735.435052:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb46d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2361:x1875400799035776:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 76us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521735.435060:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 50 00000100:00100000:2.0:1788521735.435113:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799035648 00000100:00100000:2.0:1788521735.435128:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799035648 00000100:00100000:2.0:1788521735.435186:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 200 00000100:00100000:2.0:1788521735.435194:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+10:2362:x1875400799035648:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521735.435221:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+10:2362:x1875400799035648:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 28us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521735.435227:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 200 00010000:00010000:2.0:1788521736.336393:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521737.358450:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521737.553620:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc6fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875400816894080:0@lo:400:kworker.0 00000100:00100000:1.0:1788521737.553744:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521737.553831:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc6fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816893952:0@lo:400:kworker.0 00000100:00100000:2.0:1788521737.553870:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521737.553922:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc6fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875400816894464:0@lo:400:kworker.0 00000100:00100000:2.0:1788521737.553946:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521737.553970:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788521737.553991:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc6fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816894592:0@lo:400:kworker.0 00000100:00100000:2.0:1788521737.554020:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521737.554048:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc6fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816894336:0@lo:400:kworker.0 00000100:00100000:1.0:1788521737.554078:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521737.554107:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788521737.554112:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc6ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875400816894208:0@lo:400:kworker.0 00000100:00100000:1.0:1788521737.554168:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521737.554185:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816894592 00000100:00100000:2.0:1788521737.554193:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816894592 00000100:00100000:1.0:1788521737.554206:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816894080 00000100:00100000:1.0:1788521737.554212:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816894080 00000100:00100000:1.0:1788521737.554243:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816894464 00000100:00100000:2.0:1788521737.554246:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816894336 00000100:00100000:1.0:1788521737.554247:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816894464 00000100:00100000:2.0:1788521737.554253:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816894336 00000100:00100000:1.0:1788521737.554269:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816894208 00000100:00100000:1.0:1788521737.554274:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816894208 00000100:00100000:2.0:1788521737.554281:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788521737.554297:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788521737.554305:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875400816894080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521737.554313:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbcb32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816894592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521737.554362:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875400816894080:12345-0@lo:400:kworker.0 Request processed in 56us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521737.554370:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788521737.554375:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbcb32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816894592:12345-0@lo:400:kworker.0 Request processed in 64us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521737.554384:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788521737.554390:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788521737.554401:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbcb33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875400816894464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521737.554405:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788521737.554415:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82706300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816894336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521737.554428:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788521737.554437:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:3.0:1788521737.554451:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521737.554460:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbcb33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875400816894464:12345-0@lo:400:kworker.0 Request processed in 61us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521737.554463:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82706300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816894336:12345-0@lo:400:kworker.0 Request processed in 48us (382us total) trans 0 rc 0/0 00000100:00080000:3.0:1788521737.554467:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788521737.554471:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521737.554475:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788521737.554475:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788521737.554499:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788521737.554510:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875400816894208:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788521737.554524:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fbc6fed80 x1875400816894592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521737.554538:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc6fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816894592:0@lo:400:kworker.0 00000100:00100000:1.0:1788521737.554545:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875400816894208:12345-0@lo:400:kworker.0 Request processed in 37us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521737.554553:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc6fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875400816894464:0@lo:400:kworker.0 00000100:00100000:1.0:1788521737.554555:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788521737.554594:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc6ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875400816894208:0@lo:400:kworker.0 00010000:00080000:1.0:1788521737.554607:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fbc6fdc00 x1875400816894336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521737.554615:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc6fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816894336:0@lo:400:kworker.0 00000100:00100000:1.0:1788521737.554641:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc6fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875400816894080:0@lo:400:kworker.0 00000100:00100000:0.0:1788521737.555175:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816893952 00000100:00100000:0.0:1788521737.555181:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816893952 00000100:00100000:0.0:1788521737.555218:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788521737.555224:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3306:x1875400816893952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521737.555279:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3306:x1875400816893952:12345-0@lo:400:kworker.0 Request processed in 55us (1408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521737.555285:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788521737.557681:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc6fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816893952:0@lo:400:kworker.0 00000100:00100000:0.0:1788521738.062485:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788521738.062968:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb46d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816894720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521738.063035:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521738.063413:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816894720 00000100:00100000:2.0:1788521738.063421:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816894720 00000100:00100000:2.0:1788521738.063473:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788521738.063483:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc6fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816894720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788521738.063622:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521738.063676:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc6fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816894720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 195us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521738.063697:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788521738.063775:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb46d0700 x1875400816894720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521754 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521738.063863:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb46d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816894720:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788521738.388781:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788521739.015229:0:10121:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 07:35:37 (1788521737) === 00010000:00010000:2.0:1788521739.406522:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521739.413017:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521739.413115:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799035904 00000100:00100000:0.0:1788521739.413124:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799035904 00000100:00100000:0.0:1788521739.413220:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 202 00000100:00100000:0.0:1788521739.413229:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+10:8122:x1875400799035904:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788521739.413243:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521739.413259:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f80030c00/0x1b7b50db5927bce1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe705d7355cd008c1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521739.413287:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f80030c00/0x1b7b50db5927bce1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008c1 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521739.413299:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f80030c00/0x1b7b50db5927bce1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008c1 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521739.413308:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f80030c00, rc 0) 00000100:00100000:0.0:1788521739.413365:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+11:8122:x1875400799035904:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 137us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521739.413373:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 202 00000100:00100000:3.0:1788521739.423229:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521739.424036:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799036032 00000100:00100000:2.0:1788521739.424047:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799036032 00000100:00100000:2.0:1788521739.424116:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 203 00000100:00100000:2.0:1788521739.424126:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+11:8122:x1875400799036032:12345-192.168.206.48@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788521739.424482:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+11:8122:x1875400799036032:12345-192.168.206.48@tcp:501:mount.lustre.0 Request processed in 355us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521739.424490:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 203 00000100:00100000:0.0:1788521739.434416:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521739.434547:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799036160 00000100:00100000:1.0:1788521739.434557:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799036160 00000100:00100000:1.0:1788521739.434609:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 204 00000100:00100000:1.0:1788521739.434619:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+11:8122:x1875400799036160:12345-192.168.206.48@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788521739.434837:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+11:8122:x1875400799036160:12345-192.168.206.48@tcp:503:mount.lustre.0 Request processed in 219us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521739.434845:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 204 00000100:00100000:1.0:1788521739.441833:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521739.443429:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799036288 00000100:00100000:0.0:1788521739.443454:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799036288 00000100:00100000:0.0:1788521739.443569:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 205 00000100:00100000:0.0:1788521739.443579:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+11:8126:x1875400799036288:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788521739.443865:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+11:8126:x1875400799036288:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 287us (2040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521739.443874:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 205 00000100:00100000:3.0:1788521739.478726:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521739.479294:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799036416 00000100:00100000:2.0:1788521739.479315:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799036416 00000100:00100000:2.0:1788521739.479376:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 206 00000100:00100000:2.0:1788521739.479386:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+11:8126:x1875400799036416:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788521739.479867:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+11:8126:x1875400799036416:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 480us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521739.479876:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 206 00000100:00100000:2.0:1788521739.482684:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521739.482887:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799036544 00000100:00100000:0.0:1788521739.482906:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799036544 00000100:00100000:0.0:1788521739.483030:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 207 00000100:00100000:0.0:1788521739.483042:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+11:8122:x1875400799036544:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788521739.483060:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521739.483078:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f80031600/0x1b7b50db5927bce8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe705d7355cd008eb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521739.483108:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f80031600/0x1b7b50db5927bce8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008eb expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521739.483121:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f80031600/0x1b7b50db5927bce8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008eb expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521739.483131:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f80031600, rc 0) 00000100:00100000:0.0:1788521739.483216:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+12:8122:x1875400799036544:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 177us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521739.483224:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 207 00000100:00100000:1.0:1788521739.490962:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521739.491077:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799036672 00000100:00100000:2.0:1788521739.491088:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799036672 00000100:00100000:1.0:1788521739.491185:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 208 00000100:00100000:1.0:1788521739.491197:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+12:8122:x1875400799036672:12345-192.168.206.48@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788521739.491223:0:5828:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788521739.491246:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788521739.491250:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788521739.491254:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788521739.491256:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788521739.493238:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+12:8122:x1875400799036672:12345-192.168.206.48@tcp:256:mount.lustre.0 Request processed in 2036us (2276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521739.493254:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 208 00000100:00100000:3.0:1788521739.501985:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521739.502127:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799036800 00000100:00100000:2.0:1788521739.502137:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799036800 00000100:00100000:2.0:1788521739.502220:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 209 00000100:00100000:2.0:1788521739.502231:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+12:8122:x1875400799036800:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788521739.502247:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521739.502277:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996fb490ae00/0x1b7b50db5927bcef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe705d7355cd008f2 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521739.502305:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fb490ae00/0x1b7b50db5927bcef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008f2 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521739.502318:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996fb490ae00/0x1b7b50db5927bcef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008f2 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521739.502327:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490ae00, rc 0) 00000100:00100000:2.0:1788521739.502393:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+13:8122:x1875400799036800:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 164us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521739.502401:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 209 00000100:00100000:2.0:1788521739.506208:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521739.506332:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799036928 00000100:00100000:1.0:1788521739.506341:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799036928 00000100:00100000:1.0:1788521739.506393:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 210 00000100:00100000:1.0:1788521739.506403:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+13:8122:x1875400799036928:12345-192.168.206.48@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788521739.507077:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+13:8122:x1875400799036928:12345-192.168.206.48@tcp:501:mount.lustre.0 Request processed in 673us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521739.507086:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 210 00000100:00100000:3.0:1788521739.516236:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521739.516333:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799037056 00000100:00100000:0.0:1788521739.516343:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799037056 00000100:00100000:0.0:1788521739.516404:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 211 00000100:00100000:0.0:1788521739.516415:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+13:8122:x1875400799037056:12345-192.168.206.48@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788521739.516811:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+13:8122:x1875400799037056:12345-192.168.206.48@tcp:503:mount.lustre.0 Request processed in 396us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521739.516819:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 211 00000100:00100000:2.0:1788521739.531399:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521739.531504:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799037184 00000100:00100000:1.0:1788521739.531513:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799037184 00000100:00100000:1.0:1788521739.531569:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 212 00000100:00100000:1.0:1788521739.531579:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+13:8129:x1875400799037184:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788521739.531847:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+13:8129:x1875400799037184:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 269us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521739.531856:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 212 00000100:00100000:1.0:1788521739.537236:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521739.537611:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799037312 00000100:00100000:0.0:1788521739.537864:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799037312 00000100:00100000:0.0:1788521739.537951:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 213 00000100:00100000:0.0:1788521739.537962:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+13:8129:x1875400799037312:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788521739.539940:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+13:8129:x1875400799037312:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 1971us (2710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521739.539952:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 213 00000100:00100000:3.0:1788521739.545515:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521739.546344:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799037824 00000100:00100000:0.0:1788521739.546358:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799037824 00000100:00080000:3.0:1788521739.546455:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521739.546464:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 54 00000100:00100000:0.0:1788521739.546478:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb46d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2363:x1875400799037824:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521739.546567:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb46d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2363:x1875400799037824:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 92us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521739.546575:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 54 00000100:00100000:1.0:1788521739.547534:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521739.547769:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799037440 00000100:00100000:2.0:1788521739.547780:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799037440 00000100:00100000:2.0:1788521739.547845:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:2.0:1788521739.547855:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2360:x1875400799037440:12345-192.168.206.48@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788521739.547910:0:10083:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 4e406c42-03a1-40c3-937c-c3b114a3dde8@192.168.206.48@tcp t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:2.0:1788521739.547960:0:10083:0:(genops.c:1385:class_connect()) connect: client 4e406c42-03a1-40c3-937c-c3b114a3dde8, cookie 0x1b7b50db5927bcf6 00000004:00100000:2.0:1788521739.548009:0:10083:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788521739.549442:0:10083:0:(import.c:65:import_set_state_nolock()) ffff996f87cad000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788521739.549524:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e406c42-03a1-40c3-937c-c3b114a3dde8+6:2360:x1875400799037440:12345-192.168.206.48@tcp:38:mount.lustre.0 Request processed in 1668us (1996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521739.549534:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:1.0:1788521739.575737:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521739.575786:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521739.575883:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799037696 00000100:00100000:0.0:1788521739.575893:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799037696 00000100:00100000:0.0:1788521739.575972:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799037568 00000100:00100000:0.0:1788521739.575975:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799037568 00000100:00100000:0.0:1788521739.576002:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:0.0:1788521739.576011:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e406c42-03a1-40c3-937c-c3b114a3dde8+7:8122:x1875400799037696:12345-192.168.206.48@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788521739.576054:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788521739.576132:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e406c42-03a1-40c3-937c-c3b114a3dde8+7:8122:x1875400799037696:12345-192.168.206.48@tcp:41:mount.lustre.0 Request processed in 121us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521739.576179:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:0.0:1788521739.576199:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:0.0:1788521739.576206:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e406c42-03a1-40c3-937c-c3b114a3dde8+6:0:x1875400799037568:12345-192.168.206.48@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788521739.576217:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788521739.576253:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e406c42-03a1-40c3-937c-c3b114a3dde8+6:0:x1875400799037568:12345-192.168.206.48@tcp:41:mount.lustre.0 Request processed in 47us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521739.576260:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00080000:3.0:1788521739.576381:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521739.578911:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521739.579015:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799037952 00000100:00100000:0.0:1788521739.579023:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799037952 00000100:00100000:0.0:1788521739.579079:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:0.0:1788521739.579088:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb46d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e406c42-03a1-40c3-937c-c3b114a3dde8+6:8122:x1875400799037952:12345-192.168.206.48@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788521739.579317:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb46d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e406c42-03a1-40c3-937c-c3b114a3dde8+6:8122:x1875400799037952:12345-192.168.206.48@tcp:40:mount.lustre.0 Request processed in 229us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521739.579325:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:3.0:1788521739.582105:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521739.582256:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799038080 00000100:00100000:2.0:1788521739.582265:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799038080 00000100:00100000:2.0:1788521739.582329:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:2.0:1788521739.582338:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb46d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1875400799038080:12345-192.168.206.48@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788521739.582595:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4e406c42-03a1-40c3-937c-c3b114a3dde8@192.168.206.48@tcp t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:2.0:1788521739.582626:0:6690:0:(genops.c:1385:class_connect()) connect: client 4e406c42-03a1-40c3-937c-c3b114a3dde8, cookie 0x1b7b50db5927bcfd 00002000:00100000:2.0:1788521739.582636:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4e406c42-03a1-40c3-937c-c3b114a3dde8/ffff996f87ca9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788521739.582655:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788521739.582865:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788521739.582890:0:6690:0:(import.c:65:import_set_state_nolock()) ffff996f87ca8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788521739.583057:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb46d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e406c42-03a1-40c3-937c-c3b114a3dde8+6:2360:x1875400799038080:12345-192.168.206.48@tcp:8:mount.lustre.0 Request processed in 718us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521739.583065:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:1.0:1788521739.586867:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521739.586979:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521739.587069:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799038336 00000100:00100000:3.0:1788521739.587078:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799038336 00000100:00100000:3.0:1788521739.587134:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:3.0:1788521739.587180:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4e406c42-03a1-40c3-937c-c3b114a3dde8+6:8122:x1875400799038336:12345-192.168.206.48@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788521739.587250:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788521739.587346:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4e406c42-03a1-40c3-937c-c3b114a3dde8+6:8122:x1875400799038336:12345-192.168.206.48@tcp:33:mount.lustre.0 Request processed in 203us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521739.587354:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:0.0:1788521739.587367:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799038208 00000100:00100000:0.0:1788521739.587372:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799038208 00000100:00100000:0.0:1788521739.587400:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:0.0:1788521739.587406:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82704a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1875400799038208:12345-192.168.206.48@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788521739.587428:0:6687:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4e406c42-03a1-40c3-937c-c3b114a3dde8@192.168.206.48@tcp t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:0.0:1788521739.587456:0:6687:0:(genops.c:1385:class_connect()) connect: client 4e406c42-03a1-40c3-937c-c3b114a3dde8, cookie 0x1b7b50db5927bd04 00002000:00100000:0.0:1788521739.587467:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4e406c42-03a1-40c3-937c-c3b114a3dde8/ffff996f913b6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788521739.587477:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788521739.587754:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788521739.587789:0:6687:0:(import.c:65:import_set_state_nolock()) ffff996f913b3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788521739.587843:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82704a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4e406c42-03a1-40c3-937c-c3b114a3dde8+6:2360:x1875400799038208:12345-192.168.206.48@tcp:8:mount.lustre.0 Request processed in 435us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521739.587851:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:0.0:1788521739.598443:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816894848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521739.598508:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521739.598558:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816894848 00000100:00100000:2.0:1788521739.598836:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816894848 00000100:00100000:2.0:1788521739.598916:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788521739.598933:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc6fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816894848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788521739.598956:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521739.599009:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc6fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816894848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521739.599017:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788521739.600365:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fbcb33100 x1875400816894848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521755 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521739.600389:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816894848:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788521739.600486:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788521740.434207:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521741.454479:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788521742.211742:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4e406c42-03a1-40c3-937c-c3b114a3dde8 00010000:00010000:2.0:1788521742.478906:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521742.670422:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816895360:0@lo:400:kworker.0 00000100:00100000:1.0:1788521742.670499:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521742.670560:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788521742.670577:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875400816895232:0@lo:400:kworker.0 00000100:00100000:1.0:1788521742.670604:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521742.670643:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816895360 00000100:00100000:1.0:1788521742.670650:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816895360 00000100:00100000:2.0:1788521742.670778:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816894976:0@lo:400:kworker.0 00000100:00100000:2.0:1788521742.670813:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521742.670922:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875400816895104:0@lo:400:kworker.0 00000100:00100000:0.0:1788521742.670972:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521742.671549:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875400816895488:0@lo:400:kworker.0 00000100:00100000:2.0:1788521742.671579:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521742.671612:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816894976 00000100:00100000:2.0:1788521742.671624:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816894976 00000100:00100000:2.0:1788521742.671655:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788521742.671664:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3306:x1875400816894976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521742.671719:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb45a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816895616:0@lo:400:kworker.0 00000100:00100000:2.0:1788521742.671728:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3306:x1875400816894976:12345-0@lo:400:kworker.0 Request processed in 63us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521742.671737:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788521742.671754:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521742.671774:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816895232 00000100:00100000:2.0:1788521742.671789:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816895232 00000100:00100000:0.0:1788521742.671792:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816895104 00000100:00100000:0.0:1788521742.671798:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816895104 00000100:00100000:2.0:1788521742.671818:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816895488 00000100:00100000:2.0:1788521742.671822:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816895488 00000100:00100000:0.0:1788521742.671826:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788521742.671837:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb45a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875400816895232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521742.671844:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788521742.671854:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc6fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875400816895104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521742.671898:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb45a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875400816895232:12345-0@lo:400:kworker.0 Request processed in 64us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521742.671907:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788521742.671916:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc6fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875400816895104:12345-0@lo:400:kworker.0 Request processed in 62us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521742.671925:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788521742.671934:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788521742.671973:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816894976:0@lo:400:kworker.0 00000100:00080000:3.0:1788521742.671985:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788521742.671991:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521742.672006:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816895616 00000100:00100000:3.0:1788521742.672012:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816895616 00000100:00080000:3.0:1788521742.672059:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521742.672064:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788521742.672072:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb45a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816895360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521742.672104:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb45a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816895360:12345-0@lo:400:kworker.0 Request processed in 33us (1606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521742.672110:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788521742.672123:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788521742.672129:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc6ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816895616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521742.672235:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875400816895232:0@lo:400:kworker.0 00010000:00080000:3.0:1788521742.672249:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fbfc2ea00 x1875400816895360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521742.672259:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816895360:0@lo:400:kworker.0 00000100:00100000:2.0:1788521742.672333:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc6ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816895616:12345-0@lo:400:kworker.0 Request processed in 204us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521742.672340:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788521742.673894:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbcb30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875400816895488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521742.673960:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbcb30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875400816895488:12345-0@lo:400:kworker.0 Request processed in 2028us (2380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521742.673967:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788521742.674016:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875400816895104:0@lo:400:kworker.0 00010000:00080000:0.0:1788521742.674031:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb45a6680 x1875400816895616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521742.674052:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb45a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816895616:0@lo:400:kworker.0 00000100:00100000:2.0:1788521742.674367:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875400816895488:0@lo:400:kworker.0 00000100:00100000:0.0:1788521743.182523:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb46d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816895744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521743.182657:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521743.184914:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816895744 00000100:00100000:2.0:1788521743.184925:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816895744 00000100:00100000:2.0:1788521743.185032:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788521743.185045:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc6fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816895744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788521743.185081:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521743.185175:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc6fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816895744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (2517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521743.185182:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1788521743.185262:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb46d1880 x1875400816895744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521759 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521743.185281:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb46d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816895744:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788521743.502301:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788521744.265582:0:5856:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4e406c42-03a1-40c3-937c-c3b114a3dde8 00000001:00100000:3.0:1788521744.284683:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4e406c42-03a1-40c3-937c-c3b114a3dde8 00010000:00010000:0.0:1788521744.526580:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521744.651716:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521744.652505:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521744.652528:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521744.652558:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521744.652589:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799038464 00000100:00100000:3.0:1788521744.652593:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799038848 00000100:00100000:3.0:1788521744.652598:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799038848 00000100:00100000:0.0:1788521744.652598:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799038464 00000100:00100000:3.0:1788521744.652640:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 32 00000100:00100000:0.0:1788521744.652640:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 215 00000100:00100000:3.0:1788521744.652649:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb45a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2363:x1875400799038848:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521744.652649:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+13:2363:x1875400799038464:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521744.652706:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb45a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2363:x1875400799038848:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 59us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521744.652706:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+13:2363:x1875400799038464:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 58us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521744.652715:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 32 00000100:00100000:0.0:1788521744.652715:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 215 00000100:00080000:3.0:1788521744.652734:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521744.658844:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521744.658903:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799038976 00000100:00100000:0.0:1788521744.658912:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799038976 00000100:00100000:0.0:1788521744.658982:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:0.0:1788521744.658992:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb45a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2363:x1875400799038976:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521744.659064:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb45a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2363:x1875400799038976:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 73us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521744.659073:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00080000:0.0:1788521744.663204:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521744.664013:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799038592 00000100:00100000:2.0:1788521744.664024:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799038592 00000100:00100000:2.0:1788521744.664100:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799038720 00000100:00100000:2.0:1788521744.664104:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799038720 00000100:00100000:2.0:1788521744.664169:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 58 00000100:00100000:2.0:1788521744.664180:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb45a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2363:x1875400799038592:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521744.664264:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb45a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2363:x1875400799038592:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 86us (12556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521744.664271:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 58 00000100:00100000:2.0:1788521744.664289:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 59 00000100:00100000:2.0:1788521744.664296:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb45a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2363:x1875400799038720:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521744.664319:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb45a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2363:x1875400799038720:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 24us (11761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521744.664325:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 59 00000100:00080000:0.0:1788521744.669064:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521744.719013:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816895872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521744.719087:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521744.719366:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816895872 00000100:00100000:2.0:1788521744.719374:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816895872 00000100:00100000:2.0:1788521744.719426:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788521744.719445:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb46d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816895872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788521744.719480:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521744.719528:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb46d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816895872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521744.719535:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788521744.719580:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fbcb32680 x1875400816895872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521760 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521744.719597:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816895872:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788521744.719837:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1788521744.889232:0:10319:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1788521745.550443:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521746.575345:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521747.598728:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521747.790373:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb45a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816896000:0@lo:400:kworker.0 00000100:00100000:2.0:1788521747.790448:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521747.790663:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816896000 00000100:00100000:0.0:1788521747.790671:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816896000 00000100:00100000:0.0:1788521747.790724:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788521747.790733:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3306:x1875400816896000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521747.794611:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3306:x1875400816896000:12345-0@lo:400:kworker.0 Request processed in 3873us (4156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521747.794625:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788521747.794684:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb45a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875400816896128:0@lo:400:kworker.0 00000100:00100000:0.0:1788521747.794732:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521747.794766:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb45a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816896640:0@lo:400:kworker.0 00000100:00100000:0.0:1788521747.794802:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521747.794827:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788521747.794833:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb45a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875400816896512:0@lo:400:kworker.0 00000100:00100000:0.0:1788521747.794867:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521747.794899:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816896640 00000100:00100000:0.0:1788521747.794906:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816896640 00000100:00100000:0.0:1788521747.794951:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788521747.794960:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816896640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521747.795005:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816896640:12345-0@lo:400:kworker.0 Request processed in 46us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521747.795011:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1788521747.795027:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788521747.795053:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb45a5180 x1875400816896640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521747.795066:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb45a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816896640:0@lo:400:kworker.0 00000100:00100000:1.0:1788521747.795306:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816896128 00000100:00100000:1.0:1788521747.795312:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816896128 00000100:00100000:1.0:1788521747.795344:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816896512 00000100:00100000:1.0:1788521747.795347:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816896512 00000100:00100000:1.0:1788521747.795372:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788521747.795379:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc6fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875400816896128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521747.795419:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc6fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875400816896128:12345-0@lo:400:kworker.0 Request processed in 40us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521747.795426:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788521747.795439:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788521747.795446:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875400816896512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521747.795472:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875400816896512:12345-0@lo:400:kworker.0 Request processed in 27us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521747.795478:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1788521747.795576:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521747.795599:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb45a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875400816896512:0@lo:400:kworker.0 00000100:00100000:1.0:1788521747.795609:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb45a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875400816896128:0@lo:400:kworker.0 00000100:00100000:3.0:1788521747.796890:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb45a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875400816896256:0@lo:400:kworker.0 00000100:00100000:3.0:1788521747.796947:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521747.796989:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788521747.796996:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb45a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816896384:0@lo:400:kworker.0 00000100:00100000:3.0:1788521747.797020:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521747.797051:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816896384 00000100:00100000:3.0:1788521747.797057:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816896384 00000100:00100000:3.0:1788521747.797098:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788521747.797107:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb46d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816896384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521747.797168:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb46d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816896384:12345-0@lo:400:kworker.0 Request processed in 62us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521747.797174:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1788521747.797271:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788521747.797306:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb45a5c00 x1875400816896384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521747.797320:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb45a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816896384:0@lo:400:kworker.0 00000100:00100000:0.0:1788521747.797601:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816896256 00000100:00100000:0.0:1788521747.797606:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816896256 00000100:00100000:0.0:1788521747.797654:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788521747.797668:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb46d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875400816896256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521747.797709:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb46d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875400816896256:12345-0@lo:400:kworker.0 Request processed in 42us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521747.797715:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788521747.797758:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521747.797787:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb45a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875400816896256:0@lo:400:kworker.0 00000100:00100000:2.0:1788521747.798607:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb45a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816896000:0@lo:400:kworker.0 00000100:00100000:2.0:1788521748.302605:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788521748.303839:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb46d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816896768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521748.303928:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521748.304045:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816896768 00000100:00100000:3.0:1788521748.304053:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816896768 00000100:00100000:3.0:1788521748.304096:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788521748.304105:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbcb32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816896768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788521748.304138:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521748.304201:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbcb32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816896768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521748.304213:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1788521748.304607:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb46d2300 x1875400816896768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521764 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521748.304628:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb46d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816896768:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788521748.622391:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521749.646307:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521749.770980:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521749.771081:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521749.771122:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521749.771184:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521749.771186:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799039616 00000100:00100000:2.0:1788521749.771195:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799039616 00000100:00100000:0.0:1788521749.771223:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521749.771245:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799039360 00000100:00100000:2.0:1788521749.771248:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799039488 00000100:00100000:0.0:1788521749.771248:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799039360 00000100:00100000:2.0:1788521749.771250:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799039488 00000100:00100000:2.0:1788521749.771266:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:0.0:1788521749.771272:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799039232 00000100:00100000:0.0:1788521749.771275:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799039232 00000100:00100000:2.0:1788521749.771284:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2363:x1875400799039616:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521749.771291:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 63 00000100:00100000:0.0:1788521749.771296:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2363:x1875400799039360:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521749.771349:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2363:x1875400799039616:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 66us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521749.771358:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:2.0:1788521749.771379:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 37 00000100:00100000:2.0:1788521749.771392:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2363:x1875400799039488:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521749.771392:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 64 00000100:00100000:1.0:1788521749.771409:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2363:x1875400799039232:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521749.773273:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799039104 00000100:00100000:3.0:1788521749.773284:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799039104 00000100:00100000:3.0:1788521749.773495:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 217 00000100:00100000:3.0:1788521749.773506:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+13:2363:x1875400799039104:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521749.773671:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2363:x1875400799039360:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 2371us (2587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521749.773680:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 63 00000100:00080000:0.0:1788521749.773762:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788521749.773769:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788521749.773771:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521749.773925:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2363:x1875400799039488:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 2538us (2700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521749.773935:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 37 00000100:00100000:2.0:1788521749.787982:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+13:2363:x1875400799039104:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 14467us (17000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521749.787996:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 217 00000100:00100000:0.0:1788521749.788839:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2363:x1875400799039232:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 17431us (17649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521749.788859:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 64 00000100:00100000:2.0:1788521749.838310:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788521749.838330:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816896896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521749.840931:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521749.841223:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816896896 00000100:00100000:3.0:1788521749.841233:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816896896 00000100:00100000:3.0:1788521749.841364:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788521749.841374:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbcb30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816896896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788521749.841411:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521749.841476:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbcb30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816896896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521749.841485:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788521749.841613:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fbcb31500 x1875400816896896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521765 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521749.841650:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816896896:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788521749.842290:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788521750.670622:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521751.697138:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521752.722021:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521752.912024:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816897024:0@lo:400:kworker.0 00000100:00100000:0.0:1788521752.912120:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521752.912205:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875400816897536:0@lo:400:kworker.0 00000100:00100000:0.0:1788521752.912232:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521752.912259:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788521752.912266:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875400816897152:0@lo:400:kworker.0 00000100:00100000:0.0:1788521752.912305:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521752.912325:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816897664:0@lo:400:kworker.0 00000100:00100000:0.0:1788521752.912349:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521752.912377:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875400816897280:0@lo:400:kworker.0 00000100:00100000:0.0:1788521752.912399:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521752.912417:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788521752.912422:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816897408:0@lo:400:kworker.0 00000100:00100000:0.0:1788521752.912445:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521752.912475:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816897024 00000100:00100000:0.0:1788521752.912483:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816897024 00000100:00100000:3.0:1788521752.912522:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816897536 00000100:00100000:0.0:1788521752.912531:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788521752.912535:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816897536 00000100:00100000:0.0:1788521752.912545:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3306:x1875400816897024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521752.912596:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3306:x1875400816897024:12345-0@lo:400:kworker.0 Request processed in 55us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521752.912603:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788521752.912635:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816897152 00000100:00100000:0.0:1788521752.912639:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816897152 00000100:00100000:0.0:1788521752.912671:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816897280 00000100:00100000:0.0:1788521752.912675:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816897280 00000100:00100000:3.0:1788521752.912747:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788521752.912756:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadb3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875400816897152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521752.912795:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadb3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875400816897152:12345-0@lo:400:kworker.0 Request processed in 41us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521752.912801:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788521752.912815:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788521752.912822:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875400816897536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521752.912866:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875400816897536:12345-0@lo:400:kworker.0 Request processed in 44us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521752.912872:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788521752.915298:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788521752.915316:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadb3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875400816897280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521752.915418:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadb3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875400816897280:12345-0@lo:400:kworker.0 Request processed in 107us (3016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521752.915425:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788521752.915459:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816897664 00000100:00100000:0.0:1788521752.915466:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816897664 00000100:00100000:0.0:1788521752.915495:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816897408 00000100:00100000:0.0:1788521752.915498:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816897408 00000100:00100000:0.0:1788521752.915515:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788521752.915522:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadb3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816897664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521752.915553:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadb3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816897664:12345-0@lo:400:kworker.0 Request processed in 32us (3203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521752.915559:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788521752.915572:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788521752.915578:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadb3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816897408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521752.915606:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadb3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816897408:12345-0@lo:400:kworker.0 Request processed in 29us (3161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521752.915612:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788521752.915686:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb3f5a300 x1875400816897408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521752.915702:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816897408:0@lo:400:kworker.0 00000100:00100000:0.0:1788521752.915714:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875400816897280:0@lo:400:kworker.0 00000100:00100000:0.0:1788521752.915751:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875400816897152:0@lo:400:kworker.0 00010000:00080000:0.0:1788521752.915774:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb3f59500 x1875400816897664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521752.915784:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816897664:0@lo:400:kworker.0 00000100:00100000:0.0:1788521752.915795:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816897024:0@lo:400:kworker.0 00000100:00100000:0.0:1788521752.915805:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875400816897536:0@lo:400:kworker.0 00000100:00080000:3.0:1788521752.924403:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788521752.924651:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521752.924657:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521753.422655:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fadb3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816897792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521753.422719:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521753.422942:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816897792 00000100:00100000:0.0:1788521753.422950:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816897792 00000100:00100000:0.0:1788521753.423029:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788521753.423038:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb45a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816897792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788521753.423071:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521753.423115:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb45a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816897792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521753.423122:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1788521753.423187:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fadb3d500 x1875400816897792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521769 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521753.423204:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fadb3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816897792:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788521753.742368:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521754.767307:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521754.891241:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521754.891394:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799039744 00000100:00100000:1.0:1788521754.891405:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799039744 00000100:00100000:1.0:1788521754.891451:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 219 00000100:00100000:1.0:1788521754.891461:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+13:2361:x1875400799039744:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521754.891530:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+13:2361:x1875400799039744:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 70us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521754.891538:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 219 00000100:00100000:1.0:1788521754.906380:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521754.906417:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521754.906451:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521754.906472:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521754.906508:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799040000 00000100:00100000:0.0:1788521754.906518:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799040000 00000100:00100000:2.0:1788521754.906536:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799040256 00000100:00100000:2.0:1788521754.906540:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799040256 00000100:00100000:2.0:1788521754.906577:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799040128 00000100:00100000:0.0:1788521754.906577:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799039872 00000100:00100000:2.0:1788521754.906580:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799040128 00000100:00100000:0.0:1788521754.906580:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799039872 00000100:00100000:2.0:1788521754.906596:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 40 00000100:00100000:0.0:1788521754.906597:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 68 00000100:00100000:2.0:1788521754.906605:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb45a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2362:x1875400799040256:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521754.906605:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb45a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2362:x1875400799040000:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521754.906674:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb45a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2362:x1875400799040000:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 69us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521754.906681:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 68 00000100:00080000:1.0:1788521754.906683:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788521754.906687:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788521754.906689:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521754.906698:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 69 00000100:00100000:0.0:1788521754.906704:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb45a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2362:x1875400799039872:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521754.908049:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb45a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2362:x1875400799040256:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 1436us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521754.908059:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 40 00000100:00100000:2.0:1788521754.908084:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 41 00000100:00100000:2.0:1788521754.908105:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb45a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2362:x1875400799040128:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521754.908138:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb45a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2362:x1875400799040128:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 37us (1665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521754.908160:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 41 00000100:00100000:0.0:1788521754.919485:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb45a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2362:x1875400799039872:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 12768us (13020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521754.919500:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 69 00000100:00100000:0.0:1788521754.960257:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fadb3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816897920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521754.960321:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521754.960388:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816897920 00000100:00100000:0.0:1788521754.960395:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816897920 00000100:00100000:0.0:1788521754.960454:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788521754.960463:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadb3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816897920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788521754.960494:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521754.960536:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadb3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816897920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521754.960544:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1788521754.960564:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788521754.960590:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fadb3ce00 x1875400816897920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521770 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521754.960608:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fadb3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816897920:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788521755.790414:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521756.816638:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521757.838325:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521758.030481:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875400816898176:0@lo:400:kworker.0 00000100:00100000:1.0:1788521758.030546:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521758.030602:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816898688:0@lo:400:kworker.0 00000100:00100000:1.0:1788521758.030642:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521758.030670:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788521758.030676:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816898048:0@lo:400:kworker.0 00000100:00100000:1.0:1788521758.030697:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521758.030712:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875400816898560:0@lo:400:kworker.0 00000100:00100000:1.0:1788521758.030728:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521758.030752:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816898688 00000100:00100000:1.0:1788521758.030758:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816898688 00000100:00100000:1.0:1788521758.030836:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788521758.030845:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc7d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816898688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521758.030889:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc7d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816898688:12345-0@lo:400:kworker.0 Request processed in 45us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521758.030895:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788521758.031037:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816898176 00000100:00100000:1.0:1788521758.031040:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816898176 00000100:00100000:1.0:1788521758.031060:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816898560 00000100:00100000:1.0:1788521758.031062:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816898560 00000100:00100000:1.0:1788521758.031077:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788521758.031083:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb45a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875400816898176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521758.031110:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb45a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875400816898176:12345-0@lo:400:kworker.0 Request processed in 27us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521758.031116:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788521758.031125:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788521758.031130:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb45a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875400816898560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521758.031178:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb45a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875400816898560:12345-0@lo:400:kworker.0 Request processed in 47us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521758.031184:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1788521758.031205:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788521758.031209:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788521758.031240:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875400816898560:0@lo:400:kworker.0 00000100:00100000:1.0:1788521758.031250:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875400816898176:0@lo:400:kworker.0 00010000:00080000:1.0:1788521758.031260:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fbfc2e300 x1875400816898688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521758.031270:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816898688:0@lo:400:kworker.0 00000100:00100000:0.0:1788521758.031417:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816898432:0@lo:400:kworker.0 00000100:00100000:0.0:1788521758.031446:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521758.031472:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788521758.031478:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875400816898304:0@lo:400:kworker.0 00000100:00100000:0.0:1788521758.031499:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521758.031522:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816898048 00000100:00100000:0.0:1788521758.031525:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816898048 00000100:00100000:0.0:1788521758.031548:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788521758.031560:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3307:x1875400816898048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521758.031588:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3307:x1875400816898048:12345-0@lo:400:kworker.0 Request processed in 29us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521758.031594:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788521758.031615:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816898304 00000100:00100000:0.0:1788521758.031618:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816898304 00000100:00100000:0.0:1788521758.031637:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788521758.031642:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadb3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875400816898304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521758.031668:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadb3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875400816898304:12345-0@lo:400:kworker.0 Request processed in 26us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521758.031674:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788521758.031693:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875400816898304:0@lo:400:kworker.0 00000100:00100000:1.0:1788521758.031822:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816898432 00000100:00100000:1.0:1788521758.031833:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816898432 00000100:00100000:1.0:1788521758.031863:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788521758.031870:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadb3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816898432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521758.031905:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadb3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816898432:12345-0@lo:400:kworker.0 Request processed in 36us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521758.031910:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1788521758.031929:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788521758.031932:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788521758.031948:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fbcb33100 x1875400816898432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521758.031958:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816898432:0@lo:400:kworker.0 00000100:00100000:1.0:1788521758.031979:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816898048:0@lo:400:kworker.0 00000100:00100000:1.0:1788521758.550747:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788521758.550768:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb45a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816898816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521758.550861:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521758.551045:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816898816 00000100:00100000:0.0:1788521758.551053:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816898816 00000100:00100000:0.0:1788521758.551110:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788521758.551120:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb45a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816898816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788521758.551188:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521758.551237:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb45a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816898816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521758.551245:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1788521758.551299:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb45a4700 x1875400816898816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521774 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521758.551317:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb45a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816898816:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788521758.863942:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521759.886512:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521760.012195:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521760.012371:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799040384 00000100:00100000:0.0:1788521760.012382:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799040384 00000100:00100000:0.0:1788521760.012449:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 221 00000100:00100000:0.0:1788521760.012459:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+13:2364:x1875400799040384:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521760.012551:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+13:2364:x1875400799040384:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 93us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521760.012558:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 221 00000100:00100000:1.0:1788521760.013676:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521760.013710:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521760.013745:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521760.013939:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799040768 00000100:00100000:3.0:1788521760.013947:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799040768 00000100:00100000:3.0:1788521760.013997:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799040896 00000100:00100000:3.0:1788521760.014000:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799040896 00000100:00100000:3.0:1788521760.014017:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:3.0:1788521760.014028:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb45a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2360:x1875400799040768:12345-192.168.206.48@tcp:9:kworker.0 00000020:00000080:3.0:1788521760.014053:0:6690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927bcfd 00000100:00080000:3.0:1788521760.014061:0:6690:0:(import.c:65:import_set_state_nolock()) ffff996f87ca8800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788521760.014109:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788521760.014460:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb45a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e406c42-03a1-40c3-937c-c3b114a3dde8+2:2360:x1875400799040768:12345-192.168.206.48@tcp:9:kworker.0 Request processed in 433us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521760.014468:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:3.0:1788521760.014483:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:3.0:1788521760.014489:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb45a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2360:x1875400799040896:12345-192.168.206.48@tcp:9:kworker.0 00000020:00000080:3.0:1788521760.014513:0:6690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927bd04 00000100:00080000:3.0:1788521760.014533:0:6690:0:(import.c:65:import_set_state_nolock()) ffff996f913b3800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788521760.014554:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788521760.017377:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799040640 00000100:00100000:0.0:1788521760.017393:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799040640 00000100:00100000:0.0:1788521760.017473:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 73 00000100:00100000:0.0:1788521760.017484:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb45a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2364:x1875400799040640:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521760.017555:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb45a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2364:x1875400799040640:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 73us (3882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521760.017562:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 73 00010000:00010000:0.0:1788521760.017607:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788521760.017992:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788521760.017997:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788521760.018000:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521760.018759:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb45a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e406c42-03a1-40c3-937c-c3b114a3dde8+2:2360:x1875400799040896:12345-192.168.206.48@tcp:9:kworker.0 Request processed in 4154us (4898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521760.018771:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 15 00010000:00010000:3.0:1788521760.018809:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521760.022898:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521760.023128:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799040512 00000100:00100000:1.0:1788521760.023139:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799040512 00000100:00100000:1.0:1788521760.023575:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 74 00000100:00100000:1.0:1788521760.023585:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2364:x1875400799040512:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521760.023663:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2364:x1875400799040512:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 80us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521760.023671:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 74 00000100:00080000:2.0:1788521760.028014:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521760.078486:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fadb3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816898944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788521760.078567:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521760.082484:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816898944 00000100:00100000:2.0:1788521760.082496:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816898944 00000100:00100000:2.0:1788521760.082571:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788521760.082581:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb45a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816898944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788521760.082615:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788521760.082717:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521760.083133:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb45a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816898944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 552us (4565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521760.083165:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788521760.083893:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fadb3df80 x1875400816898944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521776 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521760.083916:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fadb3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816898944:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788521760.910326:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788521761.311899:0:11018:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788521761.944589:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788521762.715985:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4e406c42-03a1-40c3-937c-c3b114a3dde8 00000020:00000080:2.0:1788521762.715996:0:6713:0:(genops.c:885:class_export_put()) final put ffff996f87ca9000/4e406c42-03a1-40c3-937c-c3b114a3dde8 00000020:00000080:1.0:1788521762.717222:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff996f87ca9000/4e406c42-03a1-40c3-937c-c3b114a3dde8 for lustre-OST0000 00000020:00000080:1.0:1788521762.717294:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff996f87ca8800 for lustre-OST0000 00010000:00010000:3.0:1788521762.959238:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521763.152219:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fadb3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816899072:0@lo:400:kworker.0 00000100:00100000:2.0:1788521763.152290:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521763.152363:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fadb3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875400816899584:0@lo:400:kworker.0 00000100:00100000:2.0:1788521763.152388:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521763.152413:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788521763.152418:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fadb3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875400816899200:0@lo:400:kworker.0 00000100:00100000:2.0:1788521763.152435:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521763.152452:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fadb3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816899712:0@lo:400:kworker.0 00000100:00100000:2.0:1788521763.152476:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521763.152507:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816899584 00000100:00100000:2.0:1788521763.152514:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816899584 00000100:00100000:1.0:1788521763.152885:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fadb3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816899456:0@lo:400:kworker.0 00000100:00100000:1.0:1788521763.152958:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521763.153090:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788521763.153098:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fadb3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875400816899328:0@lo:400:kworker.0 00000100:00100000:1.0:1788521763.153122:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521763.153220:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816899712 00000100:00100000:1.0:1788521763.153227:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816899712 00000100:00100000:1.0:1788521763.154599:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816899456 00000100:00100000:1.0:1788521763.154612:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816899456 00000100:00100000:3.0:1788521763.154614:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788521763.154640:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816899712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521763.154672:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788521763.154684:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788521763.154697:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816899200 00000100:00100000:2.0:1788521763.154706:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816899200 00000100:00100000:1.0:1788521763.154719:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816899328 00000100:00100000:1.0:1788521763.154726:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816899328 00000100:00100000:3.0:1788521763.154752:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816899712:12345-0@lo:400:kworker.0 Request processed in 122us (2272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521763.154759:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788521763.154767:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788521763.154783:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788521763.154786:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875400816899584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521763.154800:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875400816899200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521763.154808:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788521763.154825:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb45a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816899456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521763.154850:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875400816899584:12345-0@lo:400:kworker.0 Request processed in 81us (2459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521763.154858:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788521763.154881:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788521763.154898:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb45a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875400816899328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521763.154898:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875400816899200:12345-0@lo:400:kworker.0 Request processed in 98us (2454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521763.154901:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb45a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816899456:12345-0@lo:400:kworker.0 Request processed in 82us (1941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521763.154924:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788521763.154933:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1788521763.155096:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fadb3ea00 x1875400816899456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521763.155113:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fadb3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816899456:0@lo:400:kworker.0 00000100:00100000:0.0:1788521763.155200:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816899072 00000100:00100000:0.0:1788521763.155207:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816899072 00000100:00100000:0.0:1788521763.155249:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788521763.155256:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3306:x1875400816899072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521763.155293:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3306:x1875400816899072:12345-0@lo:400:kworker.0 Request processed in 38us (3002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521763.155301:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788521763.155443:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb45a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875400816899328:12345-0@lo:400:kworker.0 Request processed in 554us (2318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521763.155451:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1788521763.155489:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521763.155495:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fadb3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875400816899328:0@lo:400:kworker.0 00000100:00080000:2.0:1788521763.155498:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521763.155505:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521763.155552:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fadb3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875400816899200:0@lo:400:kworker.0 00010000:00080000:2.0:1788521763.155568:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fadb3e300 x1875400816899712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521763.155597:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fadb3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816899712:0@lo:400:kworker.0 00000100:00100000:2.0:1788521763.155609:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fadb3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816899072:0@lo:400:kworker.0 00000100:00100000:2.0:1788521763.155619:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fadb3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875400816899584:0@lo:400:kworker.0 00000100:00100000:3.0:1788521763.665114:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788521763.665136:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb46d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816899840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521763.665214:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521763.665400:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816899840 00000100:00100000:0.0:1788521763.665408:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816899840 00000100:00100000:0.0:1788521763.665472:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788521763.665482:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb46d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816899840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788521763.665513:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521763.665564:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb46d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816899840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521763.665580:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1788521763.665815:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb46d1500 x1875400816899840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521779 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521763.665834:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb46d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816899840:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788521763.982319:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788521764.474089:0:11167:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe3555be40 20000000:00000080:2.0:1788521764.474105:0:11167:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff996fb40c8400 uarg=0000000000000000 20000000:01000000:2.0:1788521764.474138:0:11167:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788521764.474171:0:11167:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788521764.474175:0:11167:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788521764.474939:0:11168:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1788521764.475163:0:11167:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788521764.482489:0:11167:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788521764.482647:0:11167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996fb490ba00/0x1b7b50db5927bd0b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521764.482667:0:11167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bcb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008ba expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521764.482676:0:11167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996f8392de00/0x1b7b50db5927bcbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bcb7 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521764.482683:0:11167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996fbc6d4400/0x1b7b50db5927bccc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bcc5 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521764.482690:0:11167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996fb490b400/0x1b7b50db5927bcda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bcd3 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521764.482697:0:11167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996fb490ae00/0x1b7b50db5927bcef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008f2 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521764.482704:0:11167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996fb490ba00/0x1b7b50db5927bd0b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521764.482750:0:11167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996fb490ae00/0x1b7b50db5927bcef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008f2 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521764.482788:0:11167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996fb490ae00/0x1b7b50db5927bcef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008f2 expref: 12 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521764.482907:0:11167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1875400816899968:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788521764.483056:0:11167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996fb490b400/0x1b7b50db5927bcda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927bcd3 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521764.483065:0:11167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996fb490b400/0x1b7b50db5927bcda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927bcd3 expref: 18 pid: 5828 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521764.483074:0:11167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1875400816900096:0@lo:104: 00000100:00100000:2.0:1788521764.483106:0:11167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788521764.483173:0:11167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996fbc6d4400/0x1b7b50db5927bccc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927bcc5 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521764.483181:0:11167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996fbc6d4400/0x1b7b50db5927bccc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927bcc5 expref: 18 pid: 5826 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521764.483189:0:11167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1875400816900224:0@lo:104: 00000100:00100000:2.0:1788521764.483210:0:11167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521764.483345:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816900096 00000100:00100000:3.0:1788521764.483353:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816900096 00000100:00100000:3.0:1788521764.483385:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816900224 00000100:00100000:3.0:1788521764.483387:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816900224 00000100:00100000:3.0:1788521764.483399:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788521764.483406:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+4:11167:x1875400816900096:12345-0@lo:104: 00010000:00010000:3.0:1788521764.483418:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927bcd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bcda expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521764.483462:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788521764.483468:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+4:11167:x1875400816900096:12345-0@lo:104: Request processed in 62us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521764.483474:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788521764.483488:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788521764.483495:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+3:11167:x1875400816900224:12345-0@lo:104: 00010000:00010000:3.0:1788521764.483502:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996f8392c000/0x1b7b50db5927bcc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bccc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521764.483532:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788521764.483537:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+3:11167:x1875400816900224:12345-0@lo:104: Request processed in 43us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521764.483552:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1788521764.483708:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788521764.483714:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927bcd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bcda expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521764.483732:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80031a00 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:3.0:1788521764.483736:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927bcd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927bcda expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521764.483745:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927bcd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927bcda expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521764.483770:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927bcd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927bcda expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521764.483775:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788521764.483810:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927bcd3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bcda expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521764.483816:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788521764.483833:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927bcd3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bcda expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521764.483840:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927bcd3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bcda expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521764.483852:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521764.483855:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f8392c000/0x1b7b50db5927bcc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bccc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521764.483860:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392c000 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:3.0:1788521764.483863:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f8392c000/0x1b7b50db5927bcc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927bccc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521764.483879:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f8392c000/0x1b7b50db5927bcc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927bccc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521764.483885:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f8392c000/0x1b7b50db5927bcc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927bccc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521764.483891:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788521764.483901:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f8392c000/0x1b7b50db5927bcc5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bccc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521764.483906:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788521764.483918:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f8392c000/0x1b7b50db5927bcc5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bccc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521764.483925:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f8392c000/0x1b7b50db5927bcc5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bccc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521764.483933:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521764.483935:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521764.483936:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521764.483941:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521764.483951:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb46d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3305:1875400816900352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521764.483981:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521764.484013:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb46d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816900480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521764.484034:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521764.484062:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816900352 00000100:00100000:3.0:1788521764.484066:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816900352 00010000:00010000:3.0:1788521764.484082:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996fb490b400/0x1b7b50db5927bcda lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bcd3 expref: 19 pid: 5828 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521764.484105:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816900480 00000100:00100000:3.0:1788521764.484108:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816900480 00010000:00010000:3.0:1788521764.484118:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996fbc6d4400/0x1b7b50db5927bccc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bcc5 expref: 20 pid: 5826 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521764.484133:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788521764.484139:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f9130b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+20:3305:x1875400816900352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788521764.484164:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521764.484169:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996fb490b400/0x1b7b50db5927bcda lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bcd3 expref: 20 pid: 5828 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521764.488487:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788521764.488505:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb46d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+20:3306:x1875400816900480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521764.488523:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521764.488532:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996fbc6d4400/0x1b7b50db5927bccc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bcc5 expref: 20 pid: 5826 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521764.489034:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996fb490b400/0x1b7b50db5927bcda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927bcd3 expref: 20 pid: 5828 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521764.489188:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521764.489352:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f9130b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+20:3305:x1875400816900352:12345-0@lo:103:ldlm_bl.0 Request processed in 5211us (5368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521764.489360:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788521764.489440:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb46d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3305:1875400816900352:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788521764.489729:0:11167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996f8392de00/0x1b7b50db5927bcbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927bcb7 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521764.489742:0:11167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996f8392de00/0x1b7b50db5927bcbe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927bcb7 expref: 19 pid: 5828 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521764.489787:0:11167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1875400816900608:0@lo:104: 00000100:00100000:2.0:1788521764.489827:0:11167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788521764.489876:0:11167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bcb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008ba expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521764.489885:0:11167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bcb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008ba expref: 12 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521764.489894:0:11167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1875400816900736:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788521764.489955:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816900608 00000100:00100000:3.0:1788521764.489961:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816900608 00000100:00100000:3.0:1788521764.490006:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788521764.490012:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+3:11167:x1875400816900608:12345-0@lo:104: 00010000:00010000:3.0:1788521764.490023:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5600/0x1b7b50db5927bcb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bcbe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521764.490067:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788521764.490078:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+3:11167:x1875400816900608:12345-0@lo:104: Request processed in 66us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521764.490084:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1788521764.490099:0:7631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521764.490104:0:7631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5600/0x1b7b50db5927bcb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bcbe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521764.490111:0:7631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5600 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:3.0:1788521764.490115:0:7631:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5600/0x1b7b50db5927bcb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927bcbe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521764.490123:0:7631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5600/0x1b7b50db5927bcb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927bcbe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521764.490130:0:7631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5600/0x1b7b50db5927bcb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927bcbe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521764.490136:0:7631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788521764.490182:0:7631:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5600/0x1b7b50db5927bcb7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bcbe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521764.490189:0:7631:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788521764.490204:0:7631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5600/0x1b7b50db5927bcb7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bcbe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521764.490211:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5600/0x1b7b50db5927bcb7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bcbe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521764.490534:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521764.490536:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521764.490538:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521764.490564:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb46d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816900864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521764.490590:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521764.490616:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816900864 00000100:00100000:3.0:1788521764.490619:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816900864 00010000:00010000:3.0:1788521764.490634:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996f8392de00/0x1b7b50db5927bcbe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bcb7 expref: 20 pid: 5828 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521764.490652:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788521764.490657:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb46d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+20:3307:x1875400816900864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788521764.490666:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521764.490670:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996f8392de00/0x1b7b50db5927bcbe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bcb7 expref: 20 pid: 5828 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521764.490679:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996f8392de00/0x1b7b50db5927bcbe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927bcb7 expref: 20 pid: 5828 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521764.490691:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521764.490712:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb46d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+20:3307:x1875400816900864:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521764.490717:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788521764.490746:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb46d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816900864:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521764.491458:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996fbc6d4400/0x1b7b50db5927bccc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927bcc5 expref: 19 pid: 5826 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521764.491473:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521764.491513:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb46d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3306:x1875400816900480:12345-0@lo:103:ldlm_bl.0 Request processed in 3016us (7478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521764.491520:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788521764.491641:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb46d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816900480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788521764.491948:0:11167:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb54e5900 going to sleep for 11 seconds 00010000:00010000:2.0:1788521764.491965:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996fb490b400/0x1b7b50db5927bcda lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927bcd3 expref: 18 pid: 5828 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521764.491986:0:11167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1875400816900096:0@lo:104: 00010000:00010000:2.0:1788521764.491996:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996fbc6d4400/0x1b7b50db5927bccc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927bcc5 expref: 17 pid: 5826 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521764.492005:0:11167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1875400816900224:0@lo:104: 00010000:00010000:2.0:1788521764.492012:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8392de00/0x1b7b50db5927bcbe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927bcb7 expref: 16 pid: 5828 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521764.492019:0:11167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1875400816900608:0@lo:104: 00000100:00100000:2.0:1788521764.492919:0:11167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1875400816899968:192.168.206.48@tcp:104: 00000100:00100000:0.0:1788521764.494520:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521764.495643:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799041024 00000100:00100000:3.0:1788521764.495654:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799041024 00010000:00010000:3.0:1788521764.495695:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996fb490ae00/0x1b7b50db5927bcef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008f2 expref: 13 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521764.495964:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 28 00000100:00100000:3.0:1788521764.495997:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadb3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8401310-f5ba-4cf2-b118-0866831b1010+13:2364:x1875400799041024:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521764.496013:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521764.496019:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996fb490ae00/0x1b7b50db5927bcef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008f2 expref: 13 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521764.496035:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996fb490ae00/0x1b7b50db5927bcef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008f2 expref: 13 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521764.496357:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996fb490ae00/0x1b7b50db5927bcef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008f2 expref: 13 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521764.496373:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521764.496466:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadb3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8401310-f5ba-4cf2-b118-0866831b1010+12:2364:x1875400799041024:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 470us (1951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521764.496473:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 28 00000100:00100000:2.0:1788521764.501482:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521764.501814:0:11167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1875400816900736:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788521764.501857:0:11167:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996fb490ba00/0x1b7b50db5927bd0b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521764.502478:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799041152 00000100:00100000:1.0:1788521764.502485:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799041152 00010000:00010000:1.0:1788521764.502520:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bcb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008ba expref: 12 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521764.502639:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 29 00000100:00100000:1.0:1788521764.502648:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8401310-f5ba-4cf2-b118-0866831b1010+12:2363:x1875400799041152:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521764.502660:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521764.502665:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bcb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008ba expref: 12 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521764.502698:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bcb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008ba expref: 12 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521764.502713:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8392c800/0x1b7b50db5927bcb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008ba expref: 12 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521764.502727:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996fb490ba00/0x1b7b50db5927bd0b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521764.502736:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fb490ba00/0x1b7b50db5927bd0b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521764.502749:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996fb490ba00/0x1b7b50db5927bd0b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521764.502762:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996fb490ba00/0x1b7b50db5927bd0b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521764.502777:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996fb490ba00/0x1b7b50db5927bd0b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521764.502784:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996fb490ba00/0x1b7b50db5927bd0b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521764.502796:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490ba00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:1.0:1788521764.502801:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996fb490ba00/0x1b7b50db5927bd0b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521764.502809:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996fb490ba00/0x1b7b50db5927bd0b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521764.502835:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996fb490ba00/0x1b7b50db5927bd0b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521764.502854:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521764.502898:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8401310-f5ba-4cf2-b118-0866831b1010+11:2363:x1875400799041152:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 251us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521764.502905:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 29 00010000:00010000:2.0:1788521764.504211:0:11167:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996fb490ba00/0x1b7b50db5927bd0b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521764.504244:0:11167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996fb490ba00/0x1b7b50db5927bd0b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521764.504252:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996fb490ba00/0x1b7b50db5927bd0b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1788521764.748096:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4e406c42-03a1-40c3-937c-c3b114a3dde8 00000020:00000080:3.0:1788521764.748106:0:7647:0:(genops.c:885:class_export_put()) final put ffff996f913b6000/4e406c42-03a1-40c3-937c-c3b114a3dde8 00000020:00000080:0.0:1788521764.749064:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff996f913b6000/4e406c42-03a1-40c3-937c-c3b114a3dde8 for lustre-OST0001 00000020:00000080:0.0:1788521764.749107:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff996f913b3800 for lustre-OST0001 00010000:00010000:3.0:1788521765.008967:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521765.134604:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521765.134647:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521765.134679:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521765.134750:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799041280 00000100:00100000:0.0:1788521765.134758:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799041280 00000100:00100000:0.0:1788521765.134822:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 223 00000100:00100000:0.0:1788521765.134832:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+11:2361:x1875400799041280:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521765.134894:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+11:2361:x1875400799041280:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 63us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521765.134902:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 223 00000100:00100000:1.0:1788521765.135068:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799041536 00000100:00100000:1.0:1788521765.135073:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799041536 00000100:00100000:1.0:1788521765.135120:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799041408 00000100:00100000:1.0:1788521765.135124:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799041408 00000100:00100000:1.0:1788521765.135174:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 78 00000100:00100000:1.0:1788521765.135182:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2361:x1875400799041536:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521765.135217:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2361:x1875400799041536:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 37us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521765.135225:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 78 00000100:00100000:1.0:1788521765.135237:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 79 00000100:00100000:1.0:1788521765.135243:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2361:x1875400799041408:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521765.135265:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2361:x1875400799041408:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 22us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521765.135271:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 79 00000100:00080000:0.0:1788521765.135336:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521765.200313:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fadb3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816900992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521765.200399:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521765.200481:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816900992 00000100:00100000:1.0:1788521765.200489:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816900992 00000100:00100000:1.0:1788521765.200550:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788521765.200560:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb46d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816900992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788521765.200608:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788521765.200699:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521765.204400:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb46d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816900992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3833us (3993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521765.204703:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1788521765.210489:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fadb3dc00 x1875400816900992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521781 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521765.210517:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fadb3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816900992:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788521766.030411:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521766.102541:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521766.102632:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799041664 00000100:00100000:3.0:1788521766.102643:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799041664 00000100:00100000:3.0:1788521766.102817:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 224 00000100:00100000:3.0:1788521766.102828:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+11:5600:x1875400799041664:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521766.102843:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521766.102862:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f8392c000/0x1b7b50db5927bd12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe705d7355cd0091c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521766.102888:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8392c000/0x1b7b50db5927bd12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0091c expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521766.102899:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f8392c000/0x1b7b50db5927bd12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0091c expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521766.102908:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392c000, rc 0) 00000100:00100000:3.0:1788521766.102965:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+12:5600:x1875400799041664:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 Request processed in 139us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521766.102972:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 224 00000100:00100000:0.0:1788521766.111399:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521766.111527:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799041792 00000100:00100000:1.0:1788521766.111550:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799041792 00000100:00100000:1.0:1788521766.111603:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 225 00000100:00100000:1.0:1788521766.111612:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+12:5600:x1875400799041792:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521766.111898:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+12:5600:x1875400799041792:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 Request processed in 286us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521766.111906:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 225 00000100:00100000:0.0:1788521766.115987:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521766.117044:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799041920 00000100:00100000:1.0:1788521766.117057:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799041920 00000100:00100000:1.0:1788521766.117120:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 226 00000100:00100000:1.0:1788521766.117130:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+12:5600:x1875400799041920:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521766.117412:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+12:5600:x1875400799041920:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 Request processed in 281us (1432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521766.117545:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 226 00000100:00100000:0.0:1788521766.129344:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521766.129538:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799042048 00000100:00100000:3.0:1788521766.129547:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799042048 00000100:00100000:3.0:1788521766.129604:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 227 00000100:00100000:3.0:1788521766.129614:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+12:5600:x1875400799042048:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521766.129632:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521766.129648:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f8392d400/0x1b7b50db5927bd19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00923 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521766.129674:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8392d400/0x1b7b50db5927bd19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00923 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521766.129699:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f8392d400/0x1b7b50db5927bd19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00923 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521766.129708:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392d400, rc 0) 00000100:00100000:3.0:1788521766.129792:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+13:5600:x1875400799042048:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 Request processed in 179us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521766.129800:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 227 00000100:00100000:0.0:1788521766.133974:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521766.135689:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799042176 00000100:00100000:1.0:1788521766.135702:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799042176 00000100:00100000:1.0:1788521766.135781:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 228 00000100:00100000:1.0:1788521766.135792:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+13:5600:x1875400799042176:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521766.136241:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+13:5600:x1875400799042176:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 Request processed in 450us (2635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521766.136258:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 228 00000100:00100000:1.0:1788521766.142109:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521766.142289:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799042304 00000100:00100000:2.0:1788521766.142298:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799042304 00000100:00100000:2.0:1788521766.142355:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 229 00000100:00100000:2.0:1788521766.142365:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+13:5600:x1875400799042304:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521766.142572:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+13:5600:x1875400799042304:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 Request processed in 207us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521766.142581:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 229 10000000:01000000:0.0:1788521766.351000:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788521766.351008:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff996f86ac1800 from 7 10000000:01000000:0.0:1788521766.351012:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788521766.351055:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f80030400/0x1b7b50db5927bd20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521766.351067:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996f80030400/0x1b7b50db5927bd20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521766.351077:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f80030400/0x1b7b50db5927bd20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521766.351098:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fadb3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816901120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788521766.351179:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521766.351270:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb47d3240 going to sleep for 11 seconds 00000100:00100000:1.0:1788521766.351922:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816901120 00000100:00100000:1.0:1788521766.351930:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816901120 00000100:00100000:1.0:1788521766.356105:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788521766.356128:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:5830:x1875400816901120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521766.356173:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521766.356191:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996fbc6d5400/0x1b7b50db5927bd27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927bd20 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521766.356222:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fbc6d5400/0x1b7b50db5927bd27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927bd20 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521766.356233:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996fbc6d5400/0x1b7b50db5927bd27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bd20 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521766.356243:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d5400, rc 0) 00000100:00100000:1.0:1788521766.356326:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:5830:x1875400816901120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (5134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521766.356333:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788521766.356893:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fadb3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816901120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521766.356914:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f80030400/0x1b7b50db5927bd20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bd27 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521766.356925:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f80030400/0x1b7b50db5927bd20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bd27 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521766.357010:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fadb3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816901248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521766.357047:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521766.357087:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb47d3240 going to sleep for 11 seconds 00000100:00100000:1.0:1788521766.359440:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816901248 00000100:00100000:1.0:1788521766.359453:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816901248 00000100:00100000:1.0:1788521766.359519:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788521766.359530:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:5830:x1875400816901248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521766.361184:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:5830:x1875400816901248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1650us (4129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521766.361197:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788521766.366027:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fadb3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816901248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521766.366101:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb46d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816901376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521766.366189:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521766.366233:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f8674e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521766.366307:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816901376 00000100:00100000:0.0:1788521766.366314:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816901376 00000100:00100000:0.0:1788521766.366376:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788521766.366386:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:5830:x1875400816901376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521766.366581:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:5830:x1875400816901376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521766.366590:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788521766.367436:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb46d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816901376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788521766.368465:0:11225:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788521766.368714:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788521766.368734:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788521766.368744:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f80030400/0x1b7b50db5927bd20 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bd27 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521766.368763:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996f80030400/0x1b7b50db5927bd20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bd27 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521766.368787:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788521766.368789:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff996f97fff000 from 7 10000000:01000000:1.0:1788521766.368792:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788521766.368823:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5c00/0x1b7b50db5927bd2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521766.368840:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5c00/0x1b7b50db5927bd2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521766.368851:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5c00/0x1b7b50db5927bd2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521766.368873:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb45a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816901504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788521766.368929:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521766.368965:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f862a9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788521766.369055:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816901504 00000100:00100000:0.0:1788521766.369063:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816901504 00000100:00100000:0.0:1788521766.369108:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788521766.369117:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:5830:x1875400816901504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521766.369129:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521766.369170:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f80031400/0x1b7b50db5927bd35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927bd2e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521766.369194:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f80031400/0x1b7b50db5927bd35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927bd2e expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521766.369343:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f80031400/0x1b7b50db5927bd35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bd2e expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521766.369352:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f80031400, rc 0) 00000100:00100000:0.0:1788521766.369397:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:5830:x1875400816901504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 281us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521766.369403:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788521766.369432:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb45a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816901504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521766.369445:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5c00/0x1b7b50db5927bd2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bd35 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521766.369455:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5c00/0x1b7b50db5927bd2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bd35 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521766.369707:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fadb3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816901632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521766.369735:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521766.369869:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb47d3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788521766.370451:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816901632 00000100:00100000:1.0:1788521766.370458:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816901632 00000100:00100000:1.0:1788521766.370490:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788521766.370498:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:5830:x1875400816901632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521766.370737:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:5830:x1875400816901632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521766.370744:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788521766.373727:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fadb3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816901632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521766.373810:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fadb3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816901760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521766.373885:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521766.373920:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb47d3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788521766.373940:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816901760 00000100:00100000:0.0:1788521766.373945:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816901760 00000100:00100000:0.0:1788521766.376777:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788521766.376796:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:5830:x1875400816901760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521766.377240:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:5830:x1875400816901760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 451us (3354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521766.377249:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788521766.384021:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fadb3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816901760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788521766.387909:0:11226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788521766.388177:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788521766.388216:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788521766.388227:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5c00/0x1b7b50db5927bd2e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bd35 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521766.388239:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5c00/0x1b7b50db5927bd2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bd35 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521766.388249:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788521766.388252:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff996f85616000 from 7 10000000:01000000:0.0:1788521766.388254:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788521766.388290:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927bd3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521766.388297:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927bd3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521766.388308:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927bd3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521766.388345:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fadb3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816901888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788521766.388419:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521766.388455:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb47d3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788521766.388934:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816901888 00000100:00100000:1.0:1788521766.388942:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816901888 00000100:00100000:1.0:1788521766.389079:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788521766.389089:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:5830:x1875400816901888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521766.389103:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521766.389115:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996fbc6d5800/0x1b7b50db5927bd43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927bd3c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521766.389138:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fbc6d5800/0x1b7b50db5927bd43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927bd3c expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521766.389178:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996fbc6d5800/0x1b7b50db5927bd43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bd3c expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521766.389187:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d5800, rc 0) 00000100:00100000:1.0:1788521766.389299:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:5830:x1875400816901888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 211us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521766.389318:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788521766.389438:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fadb3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816901888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521766.389455:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927bd3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bd43 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521766.389463:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927bd3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bd43 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521766.389811:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fadb3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816902016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521766.389846:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521766.389880:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb47d3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788521766.390710:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816902016 00000100:00100000:1.0:1788521766.390720:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816902016 00000100:00100000:1.0:1788521766.390782:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788521766.390791:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:5830:x1875400816902016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521766.391392:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:5830:x1875400816902016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 601us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521766.391401:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788521766.391428:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fadb3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816902016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521766.391477:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816902144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521766.391524:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521766.391560:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb7efdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521766.391610:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816902144 00000100:00100000:0.0:1788521766.391615:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816902144 00000100:00100000:0.0:1788521766.391655:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788521766.391663:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:5830:x1875400816902144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521766.392022:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:5830:x1875400816902144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 359us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521766.392030:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788521766.399549:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816902144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788521766.400617:0:11227:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788521766.400728:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788521766.400748:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788521766.400795:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927bd3c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bd43 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521766.400806:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927bd3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bd43 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521767.056971:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521768.079691:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521768.273520:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb45a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875400816902400:0@lo:400:kworker.0 00000100:00100000:1.0:1788521768.273585:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521768.273631:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816902912:0@lo:400:kworker.0 00000100:00100000:1.0:1788521768.273657:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521768.273693:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788521768.273698:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb45a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875400816902528:0@lo:400:kworker.0 00000100:00100000:1.0:1788521768.273719:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521768.273766:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816902400 00000100:00100000:1.0:1788521768.273773:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816902400 00000100:00100000:1.0:1788521768.273812:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816902528 00000100:00100000:1.0:1788521768.273816:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816902528 00000100:00100000:1.0:1788521768.273892:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788521768.273903:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875400816902400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521768.273957:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875400816902400:12345-0@lo:400:kworker.0 Request processed in 56us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521768.273964:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788521768.273980:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788521768.273987:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875400816902528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521768.274030:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875400816902528:12345-0@lo:400:kworker.0 Request processed in 44us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521768.274037:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788521768.274165:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816902912 00000100:00100000:1.0:1788521768.274170:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816902912 00000100:00100000:1.0:1788521768.274197:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788521768.274204:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816902912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521768.274235:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816902912:12345-0@lo:400:kworker.0 Request processed in 31us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521768.274241:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788521768.274283:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb45a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875400816902528:0@lo:400:kworker.0 00000100:00100000:1.0:1788521768.274293:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb45a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875400816902400:0@lo:400:kworker.0 00010000:00080000:1.0:1788521768.274304:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb7a8b480 x1875400816902912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521768.274314:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816902912:0@lo:400:kworker.0 00000100:00100000:2.0:1788521768.276563:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb45a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3305:1875400816902272:0@lo:400:kworker.0 00000100:00100000:2.0:1788521768.276641:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521768.276689:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875400816902784:0@lo:400:kworker.0 00000100:00100000:2.0:1788521768.276716:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521768.276732:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816902272 00000100:00100000:1.0:1788521768.276739:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816902272 00000100:00100000:2.0:1788521768.276755:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788521768.276763:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816902656:0@lo:400:kworker.0 00000100:00100000:2.0:1788521768.276788:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521768.276795:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788521768.276811:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3305:x1875400816902272:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788521768.276815:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521768.276821:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521768.276831:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816902656 00000100:00100000:2.0:1788521768.276835:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816902656 00000100:00100000:1.0:1788521768.276872:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3305:x1875400816902272:12345-0@lo:400:kworker.0 Request processed in 67us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521768.276877:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788521768.276888:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816902656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521768.276890:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788521768.276927:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816902656:12345-0@lo:400:kworker.0 Request processed in 41us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521768.276934:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1788521768.276952:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788521768.276970:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb7a88e00 x1875400816902656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521768.276983:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816902656:0@lo:400:kworker.0 00000100:00100000:2.0:1788521768.276990:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb45a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3305:1875400816902272:0@lo:400:kworker.0 00000100:00100000:2.0:1788521768.277019:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816902784 00000100:00100000:2.0:1788521768.277022:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816902784 00000100:00100000:2.0:1788521768.277058:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788521768.277063:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875400816902784:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788521768.277081:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521768.277098:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875400816902784:12345-0@lo:400:kworker.0 Request processed in 34us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521768.277104:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788521768.277125:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875400816902784:0@lo:400:kworker.0 00000001:02000400:0.0:1788521768.515739:0:11368:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788521768.788567:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fadb3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816903040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521768.788641:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521768.791071:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816903040 00000100:00100000:0.0:1788521768.791083:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816903040 00000100:00100000:0.0:1788521768.791162:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788521768.791181:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816903040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788521768.791228:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521768.791318:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816903040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (2676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521768.791325:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1788521768.791505:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fadb3ca80 x1875400816903040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521784 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521768.791525:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fadb3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816903040:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788521769.103312:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521770.126555:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521770.253868:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521770.253915:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521770.253936:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799042432 00000100:00100000:0.0:1788521770.253951:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799042560 00000100:00100000:3.0:1788521770.253952:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799042432 00000100:00100000:0.0:1788521770.253958:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799042560 00000100:00100000:0.0:1788521770.254035:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 83 00000100:00100000:3.0:1788521770.254036:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 240 00000100:00100000:3.0:1788521770.254056:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+13:2362:x1875400799042432:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521770.254056:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadb3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2362:x1875400799042560:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521770.254465:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadb3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2362:x1875400799042560:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 416us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521770.254474:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 83 00000100:00080000:0.0:1788521770.254505:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521770.259411:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+13:2362:x1875400799042432:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 5347us (5544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521770.259432:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 240 00000100:00100000:3.0:1788521770.261313:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521770.266746:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799042688 00000100:00100000:3.0:1788521770.266787:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799042688 00000100:00100000:3.0:1788521770.266903:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 84 00000100:00100000:3.0:1788521770.266918:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb46d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2361:x1875400799042688:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521770.267037:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb46d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2361:x1875400799042688:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 122us (5734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521770.267046:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 84 00000100:00080000:3.0:1788521770.267073:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521770.318605:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fadb3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816903168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521770.318723:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521770.318941:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816903168 00000100:00100000:0.0:1788521770.318953:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816903168 00000100:00100000:0.0:1788521770.319039:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788521770.319051:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb46d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816903168:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788521770.319083:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788521770.319102:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521770.319885:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb46d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816903168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 832us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521770.319895:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1788521770.321837:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fadb3c380 x1875400816903168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521786 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521770.321873:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fadb3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816903168:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788521771.150788:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788521772.152278:0:11467:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 07:36:11 (1788521771) === 00010000:00010000:1.0:1788521772.175627:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521772.459338:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521772.459397:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521772.459767:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799042816 00000100:00100000:2.0:1788521772.459777:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799042816 00000100:00100000:2.0:1788521772.459848:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:2.0:1788521772.459860:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb46d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2363:x1875400799042816:12345-192.168.206.48@tcp:41:mkdir.0 00000004:00000024:2.0:1788521772.459904:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788521772.459987:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb46d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2363:x1875400799042816:12345-192.168.206.48@tcp:41:mkdir.0 Request processed in 130us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521772.459995:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00080000:3.0:1788521772.460168:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521772.461337:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799042944 00000100:00100000:0.0:1788521772.461347:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799042944 00000100:00100000:0.0:1788521772.461452:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:0.0:1788521772.461463:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb46d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4bd13e8f-aac9-42ad-8625-a542705d6920+6:9674:x1875400799042944:12345-192.168.206.48@tcp:700:mkdir.0 00000100:00100000:0.0:1788521772.461549:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb46d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4bd13e8f-aac9-42ad-8625-a542705d6920+6:9674:x1875400799042944:12345-192.168.206.48@tcp:700:mkdir.0 Request processed in 89us (2153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521772.461557:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:0.0:1788521772.468398:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521772.468471:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799043200 00000100:00100000:2.0:1788521772.468481:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799043200 00000100:00100000:2.0:1788521772.468541:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:2.0:1788521772.468553:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadb3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+6:9674:x1875400799043200:12345-192.168.206.48@tcp:36:mkdir.0 00010000:00010000:2.0:1788521772.468605:0:10083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521772.468677:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a800/0x1b7b50db5927bc2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008a5 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.468709:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19ef000) 00010000:00010000:2.0:1788521772.468745:0:10083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521772.469065:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bd4a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.469079:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bd4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.469089:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bd4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.469118:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a000/0x1b7b50db5927bd51 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.469125:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a000/0x1b7b50db5927bd51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.469131:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a000/0x1b7b50db5927bd51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521772.471616:0:10083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788521772.471632:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bd4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.471642:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bd4a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.471650:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bd4a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.471657:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490ae00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521772.471662:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bd4a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.471685:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bd4a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.471704:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19efb00) 00010000:00010000:2.0:1788521772.471707:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521772.471713:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bd4a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.471729:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bd4a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788521772.471752:0:10083:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000010774497 reply state 00000000792a967d transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a000/0x1b7b50db5927bd51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521772.471762:0:10083:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788521772.471916:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadb3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+7:9674:x1875400799043200:12345-192.168.206.48@tcp:36:mkdir.0 Request processed in 3362us (3524us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788521772.471925:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 15 00010000:00010000:3.0:1788521772.477091:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a000/0x1b7b50db5927bd51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.477111:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a000/0x1b7b50db5927bd51 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.477119:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a000/0x1b7b50db5927bd51 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.477125:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490a000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521772.477129:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a000/0x1b7b50db5927bd51 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.477164:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a000/0x1b7b50db5927bd51 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.477186:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff996fb19ef300) 00010000:00010000:3.0:1788521772.477189:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521772.477195:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a000/0x1b7b50db5927bd51 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.477201:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a000/0x1b7b50db5927bd51 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521772.490477:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521772.490595:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799043328 00000100:00100000:2.0:1788521772.490606:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799043328 00000100:00100000:2.0:1788521772.490668:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:2.0:1788521772.490680:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadb3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+6:9675:x1875400799043328:12345-192.168.206.48@tcp:101:chmod.0 00010000:00010000:2.0:1788521772.490703:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521772.490749:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bd58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd0092a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.490811:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a800/0x1b7b50db5927bd5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.490844:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a800/0x1b7b50db5927bd5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.490855:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a800/0x1b7b50db5927bd5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521772.490891:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788521772.490895:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521772.491396:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a800/0x1b7b50db5927bd5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.491427:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bd58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0092a expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.491445:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a800/0x1b7b50db5927bd5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0092a expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.491454:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19efb00) 00010000:00010000:2.0:1788521772.491457:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788521772.491461:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490a800, rc 0) 00000100:00100000:2.0:1788521772.491561:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadb3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+7:9675:x1875400799043328:12345-192.168.206.48@tcp:101:chmod.0 Request processed in 884us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521772.491568:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:0.0:1788521772.498679:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521772.499042:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799043584 00000100:00100000:2.0:1788521772.499052:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799043584 00000100:00100000:2.0:1788521772.499220:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:2.0:1788521772.499230:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadb3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+7:9675:x1875400799043584:12345-192.168.206.48@tcp:36:chmod.0 00010000:00010000:2.0:1788521772.499278:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521772.499313:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a800/0x1b7b50db5927bd5f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0092a expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.499331:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19efb00) 00010000:00010000:2.0:1788521772.499341:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521772.499365:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bd66 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.499377:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bd66 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.499386:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bd66 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788521772.500088:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000afba2b5c reply state 0000000039d2005e transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bd66 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521772.500100:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788521772.500108:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788521772.500270:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadb3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+8:9675:x1875400799043584:12345-192.168.206.48@tcp:36:chmod.0 Request processed in 1040us (1599us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788521772.500278:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 17 00010000:00010000:3.0:1788521772.509512:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bd66 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.509540:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bd66 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.509547:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bd66 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.509553:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490ae00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521772.509557:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bd66 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.509566:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bd66 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.509582:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19ef000) 00010000:00010000:3.0:1788521772.509585:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788521772.509594:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bd66 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.509616:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bd66 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521772.540018:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521772.540367:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799043712 00000100:00100000:2.0:1788521772.540377:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799043712 00000100:00100000:2.0:1788521772.540477:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:2.0:1788521772.540488:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadb3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+7:9676:x1875400799043712:12345-192.168.206.48@tcp:101:chown.0 00010000:00010000:2.0:1788521772.540514:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521772.540537:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a800/0x1b7b50db5927bd6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00931 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.540619:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927bd74 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.540633:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927bd74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.540644:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927bd74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521772.540677:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788521772.540681:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521772.540736:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927bd74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.540761:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a800/0x1b7b50db5927bd6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00931 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.540778:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927bd74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00931 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.540796:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19efb00) 00010000:00010000:2.0:1788521772.540799:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788521772.540803:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490aa00, rc 0) 00000100:00100000:2.0:1788521772.540860:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadb3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+8:9676:x1875400799043712:12345-192.168.206.48@tcp:101:chown.0 Request processed in 374us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521772.540867:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:1.0:1788521772.543697:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521772.543869:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799043840 00000100:00100000:3.0:1788521772.543878:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799043840 00000100:00100000:3.0:1788521772.544065:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:3.0:1788521772.544077:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+8:9676:x1875400799043840:12345-192.168.206.48@tcp:101:chown.0 00010000:00010000:3.0:1788521772.544096:0:10083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521772.544116:0:10083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927bd7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00938 expref: -99 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.544505:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927bd82 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.544520:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927bd82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.544533:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927bd82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.544546:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927bd89 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.544553:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927bd89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.544560:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927bd89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.544648:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4c00/0x1b7b50db5927bd90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.544656:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4c00/0x1b7b50db5927bd90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.544662:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4c00/0x1b7b50db5927bd90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521772.544689:0:10083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788521772.544704:0:10083:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521772.545061:0:10083:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4c00/0x1b7b50db5927bd90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.545075:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927bd82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.545082:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927bd82 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.545089:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927bd82 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.545094:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521772.545098:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927bd82 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.545106:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927bd82 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.545118:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19efb00) 00010000:00010000:1.0:1788521772.545121:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521772.545125:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927bd82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.545132:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927bd82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.545484:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927bd89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.545493:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927bd89 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.545512:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927bd89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.545518:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d4600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521772.545521:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927bd89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.545527:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927bd89 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.545536:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff996fa0d5cc00) 00010000:00010000:1.0:1788521772.545539:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521772.545542:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927bd89 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.545548:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927bd89 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.545586:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927bd7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00938 expref: 10 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.545602:0:10083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4c00/0x1b7b50db5927bd90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00938 expref: 9 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.545609:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff996fa0d5c100) 00010000:00010000:1.0:1788521772.545611:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788521772.545614:0:10083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d4c00, rc 0) 00000100:00100000:1.0:1788521772.545738:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+9:9676:x1875400799043840:12345-192.168.206.48@tcp:101:chown.0 Request processed in 1661us (2047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521772.545763:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:3.0:1788521772.548956:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521772.549284:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799044096 00000100:00100000:0.0:1788521772.549293:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799044096 00000100:00100000:0.0:1788521772.549379:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:0.0:1788521772.549389:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb46d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+9:9676:x1875400799044096:12345-192.168.206.48@tcp:36:chown.0 00010000:00010000:0.0:1788521772.549438:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521772.549460:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4c00/0x1b7b50db5927bd90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00938 expref: 9 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521772.549480:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff996fa0d5c100) 00010000:00010000:0.0:1788521772.549489:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788521772.549508:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217da00/0x1b7b50db5927bd97 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521772.549519:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217da00/0x1b7b50db5927bd97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521772.549528:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217da00/0x1b7b50db5927bd97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788521772.607629:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1788521772.609417:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000105f0bb reply state 00000000972ac5ac transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217da00/0x1b7b50db5927bd97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521772.609435:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788521772.609451:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:3.0:1788521772.609581:0:5834:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788521772.609826:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb46d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+7:9676:x1875400799044096:12345-192.168.206.48@tcp:36:chown.0 Request processed in 60431us (60871us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788521772.609836:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 20 00010000:00010000:0.0:1788521772.611985:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217da00/0x1b7b50db5927bd97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521772.612003:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217da00/0x1b7b50db5927bd97 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521772.612011:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217da00/0x1b7b50db5927bd97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521772.612018:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fc217da00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521772.612023:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217da00/0x1b7b50db5927bd97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521772.612032:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217da00/0x1b7b50db5927bd97 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521772.612048:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff996f83d6d700) 00010000:00010000:0.0:1788521772.612051:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788521772.612056:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217da00/0x1b7b50db5927bd97 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521772.612062:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217da00/0x1b7b50db5927bd97 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521772.632555:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521772.632717:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799044224 00000100:00100000:0.0:1788521772.632737:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799044224 00000100:00100000:0.0:1788521772.632799:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:0.0:1788521772.632808:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb46d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+6:9677:x1875400799044224:12345-192.168.206.48@tcp:101:touch.500 00010000:00010000:0.0:1788521772.632831:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521772.632851:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217da00/0x1b7b50db5927bd9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd0093f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788521772.636279:0:5835:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3366us 00010000:00010000:3.0:1788521772.653477:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927bda5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.653505:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927bda5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.653517:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927bda5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.653543:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927bdac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.653550:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927bdac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.653557:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927bdac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.655592:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927bdb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.655609:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927bdb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.655619:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927bdb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521772.655648:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788521772.655652:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788521772.655692:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927bdb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.655715:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927bda5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.655731:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927bda5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.655738:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927bda5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.655877:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392c400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521772.655881:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927bda5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.655889:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927bda5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.655902:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19efb00) 00010000:00010000:3.0:1788521772.655905:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521772.655910:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927bda5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.655916:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927bda5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.655931:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927bdac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.655937:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927bdac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.655943:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927bdac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.655947:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392c800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521772.655950:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927bdac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.655955:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927bdac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.655973:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff996f8687ea00) 00010000:00010000:3.0:1788521772.655976:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521772.655979:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927bdac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.655985:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927bdac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.656025:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217da00/0x1b7b50db5927bd9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0093f expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.656043:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927bdb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0093f expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.656050:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff996f8687e000) 00010000:00010000:3.0:1788521772.656052:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788521772.656055:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392de00, rc 0) 00000100:00100000:3.0:1788521772.656419:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb46d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+7:9677:x1875400799044224:12345-192.168.206.48@tcp:101:touch.500 Request processed in 23608us (23868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521772.656429:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:0.0:1788521772.666779:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521772.666917:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799044480 00000100:00100000:1.0:1788521772.666927:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799044480 00000100:00100000:1.0:1788521772.666986:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:1.0:1788521772.666997:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadb3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+7:9677:x1875400799044480:12345-192.168.206.48@tcp:101:touch.500 00010000:00010000:1.0:1788521772.667017:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521772.667035:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4200/0x1b7b50db5927bdba lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00946 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.667349:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927bdc1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.667365:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927bdc1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.667377:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927bdc1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.667392:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927bdc8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.667400:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927bdc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.667407:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927bdc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788521772.668104:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788521772.668397:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927bdcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.668415:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927bdcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.668424:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927bdcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.668463:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927bdc1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.668470:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927bdc1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.668476:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927bdc1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.668480:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521772.668484:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927bdc1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.668491:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927bdc1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.668502:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff996f8687e000) 00010000:00010000:1.0:1788521772.668505:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521772.668509:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927bdc1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.668515:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927bdc1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788521772.668530:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008745959e reply state 000000003eac06e0 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927bdc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521772.668545:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788521772.668578:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4200/0x1b7b50db5927bdba lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00946 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.668593:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927bdcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00946 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.668601:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:1.0:1788521772.668603:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521772.668605:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d5e00, rc 0) 00000100:00100000:1.0:1788521772.668666:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadb3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+10:9677:x1875400799044480:12345-192.168.206.48@tcp:101:touch.500 Request processed in 1671us (1896us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788521772.668674:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 22 00010000:00010000:3.0:1788521772.674921:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927bdc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.674939:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927bdc8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.674947:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927bdc8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.674973:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d4400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521772.674978:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927bdc8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.674985:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927bdc8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.675556:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x6fc107fe (ffff996fa0d5cc00) 00010000:00010000:3.0:1788521772.675560:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521772.675565:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927bdc8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.675571:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927bdc8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521772.677499:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521772.677863:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799044736 00000100:00100000:1.0:1788521772.677872:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799044736 00000100:00100000:1.0:1788521772.677924:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:1.0:1788521772.677934:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadb3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+9:9677:x1875400799044736:12345-192.168.206.48@tcp:36:touch.500 00010000:00010000:1.0:1788521772.677987:0:10083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521772.678010:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927bdcf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00946 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.678031:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:1.0:1788521772.678041:0:10083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788521772.678085:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927bddd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.678098:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927bddd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.678122:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927bddd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788521772.678298:0:10083:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a052b6b8 reply state 00000000b8eba4f7 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927bddd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521772.678307:0:10083:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788521772.678392:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadb3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+10:9677:x1875400799044736:12345-192.168.206.48@tcp:36:touch.500 Request processed in 459us (901us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788521772.678400:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:2.0:1788521772.686972:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00010000:00010000:0.0:1788521772.687061:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927bddd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521772.687074:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927bddd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521772.687082:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927bddd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521772.687088:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d4600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521772.687092:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927bddd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521772.687100:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927bddd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521772.687118:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff996fa0d5c500) 00010000:00010000:0.0:1788521772.687121:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521772.687127:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927bddd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521772.687133:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927bddd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521772.687367:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799044864 00000100:00100000:1.0:1788521772.687383:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799044864 00000100:00100000:1.0:1788521772.687532:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 24 00000100:00100000:1.0:1788521772.687547:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+9:9677:x1875400799044864:12345-192.168.206.48@tcp:101:touch.500 00010000:00010000:1.0:1788521772.687579:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521772.688217:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927bde4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd0094d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.688317:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927bde4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0094d expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.688335:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927bde4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0094d expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.688359:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:1.0:1788521772.688363:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788521772.688367:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d5e00, rc 0) 00000100:00100000:1.0:1788521772.688480:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+10:9677:x1875400799044864:12345-192.168.206.48@tcp:101:touch.500 Request processed in 936us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521772.688489:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 24 00000100:00100000:0.0:1788521772.695538:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521772.696676:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799044992 00000100:00100000:3.0:1788521772.696689:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799044992 00000100:00100000:3.0:1788521772.696760:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:3.0:1788521772.696771:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadb3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1875400799044992:12345-192.168.206.48@tcp:8:touch.500 00010000:00080000:3.0:1788521772.696804:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4bd13e8f-aac9-42ad-8625-a542705d6920@192.168.206.48@tcp t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:3.0:1788521772.696836:0:6690:0:(genops.c:1385:class_connect()) connect: client 4bd13e8f-aac9-42ad-8625-a542705d6920, cookie 0x1b7b50db5927bdeb 00002000:00100000:3.0:1788521772.696848:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4bd13e8f-aac9-42ad-8625-a542705d6920/ffff996fad748800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788521772.696870:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788521772.697082:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788521772.697114:0:6690:0:(import.c:65:import_set_state_nolock()) ffff996fad74f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788521772.697200:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadb3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2360:x1875400799044992:12345-192.168.206.48@tcp:8:touch.500 Request processed in 430us (1673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521772.697297:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:0.0:1788521772.706304:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521772.706415:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799045120 00000100:00100000:2.0:1788521772.706433:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799045120 00000100:00100000:2.0:1788521772.706593:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:2.0:1788521772.706606:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadb3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+6:0:x1875400799045120:12345-192.168.206.48@tcp:2:touch.500 00000100:00080000:3.0:1788521772.718987:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788521772.772327:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:1.0:1788521772.772346:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4bd13e8f-aac9-42ad-8625-a542705d6920 00000100:00100000:2.0:1788521772.772881:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadb3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+5:0:x1875400799045120:12345-192.168.206.48@tcp:2:touch.500 Request processed in 66272us (66580us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788521772.772891:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:2.0:1788521772.776105:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521772.776977:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799045376 00000100:00100000:1.0:1788521772.776990:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799045376 00000100:00100000:1.0:1788521772.777107:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:1.0:1788521772.777120:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+10:9677:x1875400799045376:12345-192.168.206.48@tcp:35:touch.500 00000100:00100000:1.0:1788521772.777635:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+11:9677:x1875400799045376:12345-192.168.206.48@tcp:35:touch.500 Request processed in 517us (1537us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788521772.777644:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:3.0:1788521772.806827:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521772.806982:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799045504 00000100:00100000:1.0:1788521772.806992:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799045504 00000100:00100000:1.0:1788521772.807050:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 25 00000100:00100000:1.0:1788521772.807061:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb46d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+11:9678:x1875400799045504:12345-192.168.206.48@tcp:101:rm.0 00010000:00010000:1.0:1788521772.807082:0:10083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521772.807115:0:10083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4200/0x1b7b50db5927bdf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00954 expref: -99 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.807226:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927bdf9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.807241:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927bdf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.807252:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927bdf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521772.807302:0:10083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788521772.807305:0:10083:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521772.807341:0:10083:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927bdf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.807366:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4200/0x1b7b50db5927bdf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00954 expref: 13 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.807384:0:10083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927bdf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00954 expref: 12 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.807392:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff996f8687e000) 00010000:00010000:1.0:1788521772.807395:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788521772.807399:0:10083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d5600, rc 0) 00000100:00100000:1.0:1788521772.807455:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb46d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+12:9678:x1875400799045504:12345-192.168.206.48@tcp:101:rm.0 Request processed in 396us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521772.807463:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 25 00000100:00100000:0.0:1788521772.819431:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521772.821027:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799045760 00000100:00100000:3.0:1788521772.821120:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799045760 00000100:00100000:2.0:1788521772.822204:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 26 00000100:00100000:2.0:1788521772.822218:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadb3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+12:9678:x1875400799045760:12345-192.168.206.48@tcp:101:rm.0 00010000:00010000:2.0:1788521772.822239:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521772.822261:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927be00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd0095b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521772.822344:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788521772.822515:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927be00 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0095b expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.822529:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19efb00) 00010000:00010000:2.0:1788521772.822533:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521772.822538:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927be00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0095b expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.822553:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490a400, rc 0) 00000100:00100000:2.0:1788521772.822624:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadb3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+13:9678:x1875400799045760:12345-192.168.206.48@tcp:101:rm.0 Request processed in 409us (3203us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1788521772.822631:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 26 00000100:00100000:2.0:1788521772.830427:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521772.831668:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799045888 00000100:00100000:3.0:1788521772.831680:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799045888 00000100:00100000:3.0:1788521772.831802:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:3.0:1788521772.831814:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+13:9678:x1875400799045888:12345-192.168.206.48@tcp:37:rm.0 00000100:00100000:1.0:1788521772.836504:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+13:9678:x1875400799045888:12345-192.168.206.48@tcp:37:rm.0 Request processed in 4681us (6075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521772.836516:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:0.0:1788521772.843775:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521772.843923:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799046144 00000100:00100000:1.0:1788521772.843933:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799046144 00000100:00100000:1.0:1788521772.843987:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:1.0:1788521772.843997:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f97fd0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+13:9678:x1875400799046144:12345-192.168.206.48@tcp:35:rm.0 00000100:00100000:1.0:1788521772.844413:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f97fd0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+14:9678:x1875400799046144:12345-192.168.206.48@tcp:35:rm.0 Request processed in 416us (653us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788521772.844437:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:3.0:1788521772.849157:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521772.850629:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799046400 00000100:00100000:1.0:1788521772.850641:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799046400 00000100:00100000:1.0:1788521772.850700:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:1.0:1788521772.850710:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb46d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+14:9678:x1875400799046400:12345-192.168.206.48@tcp:101:rm.0 00010000:00010000:1.0:1788521772.850742:0:10083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521772.850767:0:10083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4200/0x1b7b50db5927be0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00962 expref: -99 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.850866:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4c00/0x1b7b50db5927be15 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.850880:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4c00/0x1b7b50db5927be15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.850890:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4c00/0x1b7b50db5927be15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521772.850900:0:10083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788521772.851049:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4200/0x1b7b50db5927be0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00962 expref: 17 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.851067:0:10083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4c00/0x1b7b50db5927be15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00962 expref: 16 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.851075:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff996f8687e000) 00010000:00010000:1.0:1788521772.851078:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788521772.851082:0:10083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d4c00, rc 0) 00000100:00100000:1.0:1788521772.851186:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb46d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+16:9678:x1875400799046400:12345-192.168.206.48@tcp:101:rm.0 Request processed in 431us (2007us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788521772.851194:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:2.0:1788521772.856060:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521772.856653:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799046528 00000100:00100000:3.0:1788521772.856663:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799046528 00000100:00100000:3.0:1788521772.856728:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 28 00000100:00100000:3.0:1788521772.856739:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+16:9678:x1875400799046528:12345-192.168.206.48@tcp:41:rm.0 00000004:00000024:3.0:1788521772.856792:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1788521772.856868:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+16:9678:x1875400799046528:12345-192.168.206.48@tcp:41:rm.0 Request processed in 131us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521772.856875:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 28 00000100:00100000:0.0:1788521772.864578:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521772.864772:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799046656 00000100:00100000:1.0:1788521772.864781:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799046656 00000100:00100000:1.0:1788521772.865594:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 29 00000100:00100000:1.0:1788521772.865606:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadb3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+16:9678:x1875400799046656:12345-192.168.206.48@tcp:101:rm.0 00010000:00010000:1.0:1788521772.865626:0:10083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521772.865647:0:10083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4200/0x1b7b50db5927be23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00969 expref: -99 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.865711:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4800/0x1b7b50db5927be2a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.865737:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4800/0x1b7b50db5927be2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.865943:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4800/0x1b7b50db5927be2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.865964:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927be31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.865972:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927be31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.865978:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927be31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.866079:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927be38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.866323:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927be38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.866334:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927be38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521772.866363:0:10083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788521772.866367:0:10083:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521772.866386:0:10083:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927be38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.866397:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927be38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.866405:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4800/0x1b7b50db5927be2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.866412:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4800/0x1b7b50db5927be2a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.866419:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4800/0x1b7b50db5927be2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.866425:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d4800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521772.866430:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4800/0x1b7b50db5927be2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.866437:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4800/0x1b7b50db5927be2a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.866450:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff996f8687e000) 00010000:00010000:1.0:1788521772.866459:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521772.866464:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4800/0x1b7b50db5927be2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.866471:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4800/0x1b7b50db5927be2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.866486:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927be31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.866492:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927be31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.866498:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927be31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.866503:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521772.866506:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927be31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.866511:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927be31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.866519:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x6fc107fe (ffff996fa0d5cb00) 00010000:00010000:1.0:1788521772.866521:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521772.866524:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927be31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.866528:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927be31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.866563:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4200/0x1b7b50db5927be23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00969 expref: 18 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.866590:0:10083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927be38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00969 expref: 17 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521772.866597:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:1.0:1788521772.866599:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521772.866601:0:10083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d5000, rc 0) 00000100:00100000:1.0:1788521772.866789:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadb3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+17:9678:x1875400799046656:12345-192.168.206.48@tcp:101:rm.0 Request processed in 1184us (2221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521772.866864:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 29 00000100:00100000:0.0:1788521772.872031:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521772.872399:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799046912 00000100:00100000:3.0:1788521772.872409:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799046912 00000100:00100000:3.0:1788521772.872513:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 30 00000100:00100000:3.0:1788521772.872524:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadb3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+17:9678:x1875400799046912:12345-192.168.206.48@tcp:36:rm.0 00010000:00010000:3.0:1788521772.872574:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788521772.872599:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927be38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00969 expref: 17 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.872643:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927bde4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0094d expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.872656:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:3.0:1788521772.872672:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927bdf9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00954 expref: 15 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.872682:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff996f8687e000) 00010000:00010000:3.0:1788521772.872686:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788521772.872705:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927be3f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.872730:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927be3f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.872741:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927be3f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.872756:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927be46 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.872763:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927be46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.872770:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927be46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.872868:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927be4d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.872886:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927be4d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.872893:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927be4d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788521772.873636:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788521772.873648:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 272858504608ns, next at 273858502159ns, rc = 0 00010000:00010000:3.0:1788521772.873702:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d000/0x1b7b50db5927be54 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.873714:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d000/0x1b7b50db5927be54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.873732:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d000/0x1b7b50db5927be54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.873739:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d000/0x1b7b50db5927be54 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.873745:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d000/0x1b7b50db5927be54 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.873750:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d000/0x1b7b50db5927be54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.873767:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521772.873784:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927be4d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.873790:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927be4d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.873803:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927be4d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.873809:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392da00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521772.873813:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927be4d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.873821:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927be4d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.873831:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff996f8687e600) 00010000:00010000:3.0:1788521772.873834:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788521772.873837:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927be4d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.873843:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927be4d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.873859:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927be3f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.873865:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927be3f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.873870:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927be3f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.873875:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392c800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521772.873878:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927be3f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.873893:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927be3f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.873901:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff996f8687e000) 00010000:00010000:3.0:1788521772.873904:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521772.873907:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927be3f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.873912:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927be3f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788521772.873921:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b86e725 reply state 0000000072eda66f transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927be46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521772.873929:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788521772.874317:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadb3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+16:9678:x1875400799046912:12345-192.168.206.48@tcp:36:rm.0 Request processed in 1791us (2291us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788521772.874326:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 30 00010000:00010000:0.0:1788521772.874480:0:7631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521772.874487:0:7631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d000/0x1b7b50db5927be54 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521772.874493:0:7631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392d000 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521772.874497:0:7631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d000/0x1b7b50db5927be54 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521772.874502:0:7631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d000/0x1b7b50db5927be54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521772.874513:0:7631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff996f8687e600) 00010000:00010000:0.0:1788521772.874515:0:7631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788521772.874518:0:7631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d000/0x1b7b50db5927be54 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521772.874522:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d000/0x1b7b50db5927be54 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521772.874538:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521772.874540:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521772.874541:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521772.880366:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927be46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.880383:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927be46 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.880391:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927be46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.880397:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392c400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521772.880401:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927be46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.880409:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927be46 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.880425:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x6fc107fe (ffff996f8687e300) 00010000:00010000:2.0:1788521772.880428:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521772.880432:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927be46 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521772.880439:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927be46 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521772.881883:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521772.882775:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799047168 00000100:00100000:3.0:1788521772.882787:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799047168 00000100:00100000:3.0:1788521772.882867:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:3.0:1788521772.882877:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+15:9678:x1875400799047168:12345-192.168.206.48@tcp:35:rm.0 00000100:00100000:3.0:1788521772.883124:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+16:9678:x1875400799047168:12345-192.168.206.48@tcp:35:rm.0 Request processed in 248us (1248us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788521772.883132:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:0.0:1788521772.888437:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521772.888542:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799047424 00000100:00100000:3.0:1788521772.888553:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799047424 00000100:00100000:3.0:1788521772.888634:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 31 00000100:00100000:3.0:1788521772.888658:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+16:9678:x1875400799047424:12345-192.168.206.48@tcp:36:rm.0 00010000:00010000:3.0:1788521772.888711:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788521772.888745:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4c00/0x1b7b50db5927be15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00962 expref: 16 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.888768:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927bdb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0093f expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.888779:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff996f8687e000) 00010000:00010000:3.0:1788521772.888795:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927bd74 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00931 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.888804:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19efb00) 00010000:00010000:3.0:1788521772.888811:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788521772.888843:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927be5b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.888855:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927be5b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.888865:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927be5b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.888875:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927be62 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.888881:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927be62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.888888:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927be62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.889199:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d000/0x1b7b50db5927be69 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.889208:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d000/0x1b7b50db5927be69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.889215:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d000/0x1b7b50db5927be69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521772.889787:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788521772.889803:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d000/0x1b7b50db5927be69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.889810:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d000/0x1b7b50db5927be69 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.889816:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d000/0x1b7b50db5927be69 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.889820:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392d000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521772.889824:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d000/0x1b7b50db5927be69 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.889831:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d000/0x1b7b50db5927be69 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.889841:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff996f8687eb00) 00010000:00010000:3.0:1788521772.889843:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788521772.889847:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d000/0x1b7b50db5927be69 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.889863:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d000/0x1b7b50db5927be69 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.889883:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927be5b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.889889:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927be5b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.889894:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927be5b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.889899:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392c800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521772.889902:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927be5b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.889907:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927be5b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.889915:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996f8687e700) 00010000:00010000:3.0:1788521772.889917:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521772.889920:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927be5b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521772.889924:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927be5b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788521772.889935:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009f5b7dbd reply state 0000000003334667 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927be62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521772.889943:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788521772.890034:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+15:9678:x1875400799047424:12345-192.168.206.48@tcp:36:rm.0 Request processed in 1376us (1604us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788521772.890041:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 31 00010000:00010000:0.0:1788521772.893630:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927be62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521772.893649:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927be62 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521772.893669:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927be62 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521772.893675:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392da00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521772.893680:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927be62 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521772.893688:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927be62 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521772.893703:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff996f8687ea00) 00010000:00010000:0.0:1788521772.893706:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521772.893710:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927be62 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521772.893716:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927be62 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521773.200306:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521773.391509:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816903680:0@lo:400:kworker.0 00000100:00100000:1.0:1788521773.391560:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875400816903424:0@lo:400:kworker.0 00000100:00100000:3.0:1788521773.391584:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521773.391604:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521773.391609:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3305:1875400816903296:0@lo:400:kworker.0 00000100:00100000:0.0:1788521773.391657:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521773.391671:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816903936:0@lo:400:kworker.0 00000100:00100000:0.0:1788521773.391702:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875400816903808:0@lo:400:kworker.0 00000100:00100000:1.0:1788521773.391723:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521773.391749:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816903296 00000100:00100000:3.0:1788521773.391756:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816903296 00000100:00100000:3.0:1788521773.391803:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788521773.392311:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521773.392352:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875400816903552:0@lo:400:kworker.0 00000100:00100000:0.0:1788521773.392382:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521773.392497:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816903424 00000100:00100000:0.0:1788521773.392502:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816903424 00000100:00100000:0.0:1788521773.392534:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816903808 00000100:00100000:0.0:1788521773.392537:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816903808 00000100:00100000:0.0:1788521773.392578:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816903552 00000100:00100000:0.0:1788521773.392581:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816903552 00000100:00100000:0.0:1788521773.392597:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788521773.392604:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875400816903424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521773.392650:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875400816903424:12345-0@lo:400:kworker.0 Request processed in 46us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521773.392657:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788521773.392677:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788521773.392684:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875400816903808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521773.392810:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875400816903808:12345-0@lo:400:kworker.0 Request processed in 125us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521773.392817:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788521773.392831:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788521773.392838:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875400816903552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521773.392872:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875400816903552:12345-0@lo:400:kworker.0 Request processed in 35us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521773.392879:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788521773.392914:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875400816903552:0@lo:400:kworker.0 00000100:00100000:0.0:1788521773.392943:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875400816903808:0@lo:400:kworker.0 00000100:00080000:0.0:1788521773.393071:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521773.395366:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816903680 00000100:00100000:2.0:1788521773.395380:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816903680 00000100:00100000:2.0:1788521773.395449:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816903936 00000100:00100000:2.0:1788521773.395458:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816903936 00000100:00100000:2.0:1788521773.395486:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788521773.395496:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816903680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521773.395597:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816903680:12345-0@lo:400:kworker.0 Request processed in 103us (4013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521773.395605:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788521773.395621:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788521773.395628:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816903936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521773.395657:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816903936:12345-0@lo:400:kworker.0 Request processed in 30us (3944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521773.395664:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1788521773.395690:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521773.395694:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788521773.395765:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996f85dc3b80 x1875400816903680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521773.395780:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816903680:0@lo:400:kworker.0 00010000:00080000:1.0:1788521773.397460:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996f85dc2d80 x1875400816903936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521773.397477:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816903936:0@lo:400:kworker.0 00000100:00100000:1.0:1788521773.397510:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875400816903424:0@lo:400:kworker.0 00000100:00100000:3.0:1788521773.397677:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3305:x1875400816903296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521773.397810:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3305:x1875400816903296:12345-0@lo:400:kworker.0 Request processed in 5998us (6153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521773.397828:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788521773.398500:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3305:1875400816903296:0@lo:400:kworker.0 00000100:00100000:1.0:1788521773.902388:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788521773.902413:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816904064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521773.902481:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521773.902670:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816904064 00000100:00100000:3.0:1788521773.902677:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816904064 00000100:00100000:3.0:1788521773.902731:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788521773.902741:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb45a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816904064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788521773.902775:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521773.902829:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb45a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816904064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521773.902835:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1788521773.902966:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb3f59880 x1875400816904064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521789 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521773.902984:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816904064:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788521774.222423:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521775.249719:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521775.372500:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521775.372534:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521775.372573:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521775.372600:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521775.372640:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799047680 00000100:00100000:0.0:1788521775.372650:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799047680 00000100:00100000:0.0:1788521775.372720:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799047936 00000100:00100000:0.0:1788521775.372724:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799047936 00000100:00100000:0.0:1788521775.372753:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 88 00000100:00100000:3.0:1788521775.372763:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799047552 00000100:00100000:0.0:1788521775.372764:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+14:2364:x1875400799047680:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521775.372771:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799047552 00000100:00100000:1.0:1788521775.372784:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799047808 00000100:00100000:1.0:1788521775.372790:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799047808 00000100:00100000:3.0:1788521775.372823:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 242 00000100:00100000:1.0:1788521775.372832:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 50 00000100:00100000:3.0:1788521775.372838:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+13:2364:x1875400799047552:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521775.372847:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2364:x1875400799047808:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521775.372847:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+14:2364:x1875400799047680:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 84us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521775.372861:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 88 00000100:00100000:1.0:1788521775.372880:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2364:x1875400799047808:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 38us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521775.372880:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 89 00000100:00100000:1.0:1788521775.372888:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 50 00000100:00100000:0.0:1788521775.372888:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2364:x1875400799047936:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521775.372895:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+13:2364:x1875400799047552:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 62us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521775.372904:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 242 00000100:00100000:0.0:1788521775.372932:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2364:x1875400799047936:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 43us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521775.372939:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 89 00000100:00080000:0.0:1788521775.372962:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788521775.372966:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1788521775.439469:0:6740:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 275424324341ns, next at 276424322128ns, rc = 0 00000100:00100000:2.0:1788521775.439492:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788521775.439511:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816904192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521775.439575:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521775.439659:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816904192 00000100:00100000:0.0:1788521775.439667:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816904192 00000100:00100000:0.0:1788521775.439754:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788521775.439764:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816904192:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788521775.439854:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788521775.440107:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521775.440331:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816904192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 567us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521775.440339:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788521775.440530:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996f85dc3b80 x1875400816904192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521791 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521775.440548:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816904192:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788521776.270334:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788521777.012944:0:11617:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1788521777.295062:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788521778.064812:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967305 is committed 00000004:00080000:2.0:1788521778.064836:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1788521778.064850:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1788521778.064855:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788521778.064982:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816904320:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788521778.065049:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521778.065118:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816904320 00000100:00100000:2.0:1788521778.065126:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816904320 00000100:00100000:2.0:1788521778.065418:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788521778.065427:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816904320:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788521778.065452:0:6690:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1788521778.065487:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9aad2d, atime: 0x6a9aad2d, ctime: 0x6a9aad2d, blocks: 0x1 00010000:00010000:2.0:1788521778.065495:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2b18cb6/0x1b7b50db5927be70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521778.065511:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=278s v=(0 0) 00010000:00010000:2.0:1788521778.065515:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521778.065521:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2b18cb6/0x1b7b50db5927be70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521778.065539:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2b18cb6/0x1b7b50db5927be70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521778.065548:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2b18cb6/0x1b7b50db5927be70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521778.065556:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2b18cb6/0x1b7b50db5927be70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521778.065574:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1788521778.066247:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521778.066381:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1875400816904320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 954us (1331us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788521778.066397:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788521778.067464:0:7631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521778.067474:0:7631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2b18cb6/0x1b7b50db5927be70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521778.067486:0:7631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490b000 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:2.0:1788521778.067491:0:7631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2b18cb6/0x1b7b50db5927be70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521778.067501:0:7631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2b18cb6/0x1b7b50db5927be70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521778.067521:0:7631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2b18cb6/0x1b7b50db5927be70 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521778.067529:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2b18cb6/0x1b7b50db5927be70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521778.067547:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521778.067549:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521778.067551:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788521778.069167:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff996f85dc3b80/2, rc 0, transno 4294967300 00000100:00100000:0.0:1788521778.069299:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816904320:0@lo:6:osp-syn-0-0.0 00000020:00000080:2.0:1788521778.096780:0:11666:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd061efc00 20000000:00000080:2.0:1788521778.096797:0:11666:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff996fb4a94000 uarg=0000000000000000 20000000:01000000:2.0:1788521778.096831:0:11666:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788521778.096837:0:11666:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788521778.096842:0:11666:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788521778.097892:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788521778.098048:0:11666:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788521778.107116:0:11666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788521778.107302:0:11666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788521778.107362:0:11666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788521778.107379:0:11666:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788521778.107397:0:11666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996fb490b000/0x1b7b50db5927be77 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521778.107415:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996f8392c000/0x1b7b50db5927bd12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0091c expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521778.107429:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996f8392d400/0x1b7b50db5927bd19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00923 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521778.107436:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996fbc6d5400/0x1b7b50db5927bd27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bd20 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521778.107442:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996f80031400/0x1b7b50db5927bd35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bd2e expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521778.107448:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996fbc6d5800/0x1b7b50db5927bd43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927bd3c expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521778.107454:0:11666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996fb490b000/0x1b7b50db5927be77 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521778.107492:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996fbc6d5800/0x1b7b50db5927bd43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927bd3c expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521778.107510:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996fbc6d5800/0x1b7b50db5927bd43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927bd3c expref: 18 pid: 5826 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521778.107523:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875400816904448:0@lo:104: 00000100:00100000:2.0:1788521778.107591:0:11666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788521778.107707:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996f80031400/0x1b7b50db5927bd35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927bd2e expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521778.107716:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996f80031400/0x1b7b50db5927bd35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927bd2e expref: 18 pid: 5827 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521778.107732:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875400816904576:0@lo:104: 00000100:00100000:2.0:1788521778.107752:0:11666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788521778.108040:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996fbc6d5400/0x1b7b50db5927bd27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927bd20 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521778.108049:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996fbc6d5400/0x1b7b50db5927bd27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927bd20 expref: 18 pid: 5827 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521778.108058:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875400816904704:0@lo:104: 00000100:00100000:2.0:1788521778.108082:0:11666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521778.108202:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816904448 00000100:00100000:1.0:1788521778.108209:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816904448 00000100:00100000:1.0:1788521778.108243:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816904576 00000100:00100000:1.0:1788521778.108245:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816904576 00000100:00100000:1.0:1788521778.108256:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788521778.108265:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+4:11666:x1875400816904448:12345-0@lo:104: 00010000:00010000:1.0:1788521778.108277:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927bd3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bd43 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521778.108323:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788521778.108328:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+4:11666:x1875400816904448:12345-0@lo:104: Request processed in 64us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521778.108334:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788521778.108348:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788521778.108354:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+3:11666:x1875400816904576:12345-0@lo:104: 00010000:00010000:1.0:1788521778.108361:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5c00/0x1b7b50db5927bd2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bd35 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521778.108385:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788521778.108397:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+3:11666:x1875400816904576:12345-0@lo:104: Request processed in 43us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521778.108403:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1788521778.108417:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788521778.108422:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927bd3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bd43 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521778.108429:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80031a00 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:1.0:1788521778.108433:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927bd3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927bd43 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521778.108441:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927bd3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927bd43 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521778.108461:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927bd3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927bd43 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521778.108467:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788521778.108492:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927bd3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bd43 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521778.108498:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788521778.108514:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927bd3c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bd43 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521778.108522:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f80031a00/0x1b7b50db5927bd3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bd43 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521778.108533:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521778.108536:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5c00/0x1b7b50db5927bd2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bd35 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521778.108551:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5c00 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:1.0:1788521778.108554:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5c00/0x1b7b50db5927bd2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927bd35 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521778.108561:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5c00/0x1b7b50db5927bd2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927bd35 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521778.108568:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5c00/0x1b7b50db5927bd2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927bd35 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521778.108572:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788521778.108582:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5c00/0x1b7b50db5927bd2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bd35 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521778.108587:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788521778.108592:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5c00/0x1b7b50db5927bd2e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bd35 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521778.108598:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5c00/0x1b7b50db5927bd2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bd35 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521778.108608:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521778.108609:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521778.108611:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521778.108621:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb45a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816904832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788521778.108646:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521778.108664:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788521778.108668:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb45a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816904960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788521778.108705:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521778.108738:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816904832 00000100:00100000:1.0:1788521778.108741:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816904832 00010000:00010000:1.0:1788521778.108759:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996fbc6d5800/0x1b7b50db5927bd43 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bd3c expref: 19 pid: 5826 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521778.108786:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816904960 00000100:00100000:1.0:1788521778.108789:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816904960 00010000:00010000:1.0:1788521778.108799:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996f80031400/0x1b7b50db5927bd35 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bd2e expref: 20 pid: 5827 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521778.108813:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788521778.108819:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98072680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+20:3306:x1875400816904832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788521778.108828:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521778.108833:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996fbc6d5800/0x1b7b50db5927bd43 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bd3c expref: 20 pid: 5826 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521778.108847:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996fbc6d5800/0x1b7b50db5927bd43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927bd3c expref: 20 pid: 5826 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521778.108861:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521778.108887:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98072680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+20:3306:x1875400816904832:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521778.108892:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788521778.108903:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788521778.108909:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98070000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3306:x1875400816904960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788521778.108915:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521778.108919:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996f80031400/0x1b7b50db5927bd35 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bd2e expref: 19 pid: 5827 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521778.108939:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996f80031400/0x1b7b50db5927bd35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927bd2e expref: 19 pid: 5827 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521778.108948:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521778.108970:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98070000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3306:x1875400816904960:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521778.108976:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788521778.109014:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb45a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816904960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788521778.109023:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb45a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816904832:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788521778.109600:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996f8392d400/0x1b7b50db5927bd19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00923 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521778.109615:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996f8392d400/0x1b7b50db5927bd19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00923 expref: 12 pid: 5826 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521778.109627:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875400816905088:192.168.206.48@tcp:104: 00000100:00100000:1.0:1788521778.109837:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788521778.109848:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816904704 00000100:00100000:1.0:1788521778.109853:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816904704 00000100:00100000:1.0:1788521778.109875:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788521778.109882:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadf3f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+3:11666:x1875400816904704:12345-0@lo:104: 00010000:00010000:1.0:1788521778.109891:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996f80030400/0x1b7b50db5927bd20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bd27 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521778.109929:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788521778.109934:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadf3f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+3:11666:x1875400816904704:12345-0@lo:104: Request processed in 53us (1852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521778.109940:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1788521778.109970:0:7631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521778.109975:0:7631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f80030400/0x1b7b50db5927bd20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927bd27 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521778.109981:0:7631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80030400 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:1.0:1788521778.109991:0:7631:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f80030400/0x1b7b50db5927bd20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927bd27 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521778.109999:0:7631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f80030400/0x1b7b50db5927bd20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927bd27 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521778.110006:0:7631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f80030400/0x1b7b50db5927bd20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927bd27 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521778.110012:0:7631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788521778.110027:0:7631:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f80030400/0x1b7b50db5927bd20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bd27 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521778.110032:0:7631:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788521778.110048:0:7631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f80030400/0x1b7b50db5927bd20 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bd27 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521778.110055:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f80030400/0x1b7b50db5927bd20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927bd27 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521778.110068:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521778.110070:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521778.110072:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521778.110081:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816905216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788521778.110105:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521778.110130:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816905216 00000100:00100000:1.0:1788521778.110133:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816905216 00010000:00010000:1.0:1788521778.110162:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996fbc6d5400/0x1b7b50db5927bd27 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bd20 expref: 19 pid: 5827 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521778.110180:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788521778.110193:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f856e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3304:x1875400816905216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788521778.110203:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521778.110207:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996fbc6d5400/0x1b7b50db5927bd27 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927bd20 expref: 19 pid: 5827 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521778.110217:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996fbc6d5400/0x1b7b50db5927bd27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927bd20 expref: 19 pid: 5827 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521778.110227:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521778.110254:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f856e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3304:x1875400816905216:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521778.110259:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788521778.110308:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816905216:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788521778.111938:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996f8392c000/0x1b7b50db5927bd12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0091c expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521778.111956:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996f8392c000/0x1b7b50db5927bd12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0091c expref: 12 pid: 5826 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521778.111985:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875400816905344:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788521778.112049:0:11666:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb47d3900 going to sleep for 11 seconds 00010000:00010000:2.0:1788521778.112071:0:11666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996fbc6d5800/0x1b7b50db5927bd43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927bd3c expref: 18 pid: 5826 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521778.112085:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875400816904448:0@lo:104: 00010000:00010000:2.0:1788521778.112095:0:11666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f80031400/0x1b7b50db5927bd35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927bd2e expref: 17 pid: 5827 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521778.112104:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875400816904576:0@lo:104: 00010000:00010000:2.0:1788521778.112112:0:11666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996fbc6d5400/0x1b7b50db5927bd27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927bd20 expref: 16 pid: 5827 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521778.112120:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875400816904704:0@lo:104: 00010000:00010000:2.0:1788521778.112195:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521778.117051:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521778.117169:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799048064 00000100:00100000:1.0:1788521778.117177:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799048064 00000100:00100000:3.0:1788521778.117194:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875400816905088:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788521778.117210:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996f8392d400/0x1b7b50db5927bd19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00923 expref: 13 pid: 5826 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521778.117242:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:1.0:1788521778.117251:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8401310-f5ba-4cf2-b118-0866831b1010+13:2364:x1875400799048064:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521778.117265:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521778.117270:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996f8392d400/0x1b7b50db5927bd19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00923 expref: 13 pid: 5826 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521778.117286:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996f8392d400/0x1b7b50db5927bd19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00923 expref: 13 pid: 5826 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521778.117303:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8392d400/0x1b7b50db5927bd19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00923 expref: 13 pid: 5826 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521778.117329:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521778.117384:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8401310-f5ba-4cf2-b118-0866831b1010+12:2364:x1875400799048064:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 133us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521778.117391:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:1.0:1788521778.126491:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521778.126589:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875400816905344:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788521778.126625:0:11666:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996fb490b000/0x1b7b50db5927be77 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521778.126715:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799048192 00000100:00100000:0.0:1788521778.126722:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799048192 00010000:00010000:0.0:1788521778.126754:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996f8392c000/0x1b7b50db5927bd12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0091c expref: 12 pid: 5826 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521778.126844:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 34 00000100:00100000:3.0:1788521778.126855:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8401310-f5ba-4cf2-b118-0866831b1010+12:2363:x1875400799048192:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521778.126870:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521778.126876:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996f8392c000/0x1b7b50db5927bd12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0091c expref: 12 pid: 5826 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521778.126894:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996f8392c000/0x1b7b50db5927bd12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0091c expref: 12 pid: 5826 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521778.126911:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8392c000/0x1b7b50db5927bd12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0091c expref: 12 pid: 5826 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521778.126924:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996fb490b000/0x1b7b50db5927be77 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521778.126943:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fb490b000/0x1b7b50db5927be77 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521778.126958:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996fb490b000/0x1b7b50db5927be77 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521778.126978:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996fb490b000/0x1b7b50db5927be77 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521778.126985:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996fb490b000/0x1b7b50db5927be77 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521778.126991:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996fb490b000/0x1b7b50db5927be77 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521778.126996:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490b000 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521778.127000:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996fb490b000/0x1b7b50db5927be77 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521778.127008:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996fb490b000/0x1b7b50db5927be77 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521778.127030:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996fb490b000/0x1b7b50db5927be77 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521778.127040:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521778.127089:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8401310-f5ba-4cf2-b118-0866831b1010+11:2363:x1875400799048192:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 236us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521778.127097:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 34 00010000:00010000:1.0:1788521778.127282:0:11666:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996fb490b000/0x1b7b50db5927be77 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521778.127290:0:11666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996fb490b000/0x1b7b50db5927be77 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521778.127296:0:11666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996fb490b000/0x1b7b50db5927be77 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521778.319096:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521778.510633:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788521778.510656:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816905856:0@lo:400:kworker.0 00000100:00100000:3.0:1788521778.510657:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875400816905728:0@lo:400:kworker.0 00000100:00100000:2.0:1788521778.510747:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875400816905600:0@lo:400:kworker.0 00000100:00100000:0.0:1788521778.518301:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521778.518418:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816905856 00000100:00100000:1.0:1788521778.518429:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816905856 00000100:00100000:1.0:1788521778.518508:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788521778.518517:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816905856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521778.518586:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816905856:12345-0@lo:400:kworker.0 Request processed in 69us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521778.518593:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1788521778.518615:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788521778.519066:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fbfc2c000 x1875400816905856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521778.519081:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816905856:0@lo:400:kworker.0 00000100:00100000:0.0:1788521778.519092:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816905472:0@lo:400:kworker.0 00000100:00100000:0.0:1788521778.520067:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521778.520137:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816905472 00000100:00100000:2.0:1788521778.520162:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816905472 00000100:00100000:2.0:1788521778.520263:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788521778.520281:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816905472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521778.525253:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521778.525343:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816905728 00000100:00100000:3.0:1788521778.525351:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816905728 00000100:00100000:3.0:1788521778.525536:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788521778.526036:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875400816905728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521778.526312:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875400816905728:12345-0@lo:400:kworker.0 Request processed in 698us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521778.526320:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788521778.526342:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788521778.526348:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521778.526361:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816905600 00000100:00100000:2.0:1788521778.526724:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816905472:12345-0@lo:400:kworker.0 Request processed in 6444us (6657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521778.526733:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788521778.526794:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875400816905728:0@lo:400:kworker.0 00000100:00100000:1.0:1788521778.526916:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816905472:0@lo:400:kworker.0 00000100:00100000:3.0:1788521778.527022:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816905600 00000100:00100000:3.0:1788521778.527205:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788521778.527213:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875400816905600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521778.527266:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875400816905600:12345-0@lo:400:kworker.0 Request processed in 54us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521778.527273:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788521778.527612:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875400816905600:0@lo:400:kworker.0 00000100:00080000:1.0:1788521778.532604:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521779.022484:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816905984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521779.022579:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521779.022794:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816905984 00000100:00100000:0.0:1788521779.022801:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816905984 00000100:00100000:0.0:1788521779.022851:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788521779.022862:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816905984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788521779.022902:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521779.022953:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816905984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521779.022961:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1788521779.023296:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb7f43480 x1875400816905984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521779.023314:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816905984:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788521779.342369:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788521779.406352:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788521779.406359:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff996f86ac1800 from 7 10000000:01000000:1.0:1788521779.406364:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788521779.406407:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927be7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521779.406419:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927be7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521779.406431:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927be7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521779.406465:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98070700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816906112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788521779.406528:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521779.406580:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f9ec493c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521779.407880:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816906112 00000100:00100000:3.0:1788521779.407891:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816906112 00000100:00100000:3.0:1788521779.408000:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788521779.408012:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:5830:x1875400816906112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521779.408027:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521779.408045:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f8392d000/0x1b7b50db5927be85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927be7e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521779.408073:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8392d000/0x1b7b50db5927be85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927be7e expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521779.408084:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f8392d000/0x1b7b50db5927be85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927be7e expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521779.408106:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392d000, rc 0) 00000100:00100000:3.0:1788521779.408208:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:5830:x1875400816906112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (1678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521779.408230:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788521779.408319:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98070700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816906112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521779.408337:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927be7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927be85 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521779.408353:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927be7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927be85 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521779.408415:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816906240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521779.408451:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521779.408967:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fad6d4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788521779.409033:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816906240 00000100:00100000:1.0:1788521779.409038:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816906240 00000100:00100000:1.0:1788521779.409068:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788521779.409074:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:5830:x1875400816906240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521779.409323:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:5830:x1875400816906240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521779.409331:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788521779.409473:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816906240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521779.409509:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816906368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521779.409553:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521779.409583:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fad6d4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788521779.411230:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816906368 00000100:00100000:3.0:1788521779.411242:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816906368 00000100:00100000:3.0:1788521779.411357:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788521779.411367:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:5830:x1875400816906368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521779.411638:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:5830:x1875400816906368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 273us (2084us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521779.411647:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788521779.411771:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816906368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521779.412606:0:11679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:11679:1875400816906496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521779.412671:0:11679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521779.412719:0:11679:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86989600 going to sleep for 11 seconds 00000100:00100000:3.0:1788521779.412799:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816906496 00000100:00100000:3.0:1788521779.412805:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816906496 00000100:00100000:3.0:1788521779.412848:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788521779.412858:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:11679:x1875400816906496:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521779.413030:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:11679:x1875400816906496:12345-0@lo:502:llog_process_th.0 Request processed in 174us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521779.413036:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788521779.413231:0:11679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:11679:1875400816906496:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788521779.413256:0:11679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788521779.413265:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521779.413267:0:11679:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788521779.413273:0:11679:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff996f86ac1800 00000020:00000080:1.0:1788521779.413275:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788521779.413350:0:11679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:11679:1875400816906624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521779.413385:0:11679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521779.413812:0:11679:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86989600 going to sleep for 11 seconds 00000100:00100000:3.0:1788521779.416308:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816906624 00000100:00100000:3.0:1788521779.416322:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816906624 00000100:00100000:3.0:1788521779.416413:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788521779.416424:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:11679:x1875400816906624:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521779.416665:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:11679:x1875400816906624:12345-0@lo:502:llog_process_th.0 Request processed in 243us (3279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521779.416673:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788521779.416776:0:11679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:11679:1875400816906624:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788521779.416809:0:11679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521779.416817:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521779.416819:0:11679:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788521779.416823:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788521779.416943:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788521779.416960:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788521779.416969:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927be7e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927be85 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521779.416979:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927be7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927be85 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521779.416989:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788521779.416991:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff996f97fff000 from 7 10000000:01000000:2.0:1788521779.416994:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788521779.417024:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490b400/0x1b7b50db5927be8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521779.417032:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996fb490b400/0x1b7b50db5927be8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521779.417041:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996fb490b400/0x1b7b50db5927be8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521779.417061:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816906752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788521779.417108:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521779.424027:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb47d3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788521779.424113:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816906752 00000100:00100000:0.0:1788521779.424122:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816906752 00000100:00100000:0.0:1788521779.424179:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788521779.424188:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:5830:x1875400816906752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521779.424204:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521779.424221:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996fc217c400/0x1b7b50db5927be93 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927be8c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521779.424249:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fc217c400/0x1b7b50db5927be93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927be8c expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521779.424259:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996fc217c400/0x1b7b50db5927be93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927be8c expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521779.424280:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fc217c400, rc 0) 00000100:00100000:0.0:1788521779.424337:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:5830:x1875400816906752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (7229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521779.424343:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788521779.424619:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816906752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521779.424638:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996fb490b400/0x1b7b50db5927be8c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927be93 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521779.424661:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996fb490b400/0x1b7b50db5927be8c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927be93 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521779.424745:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816906880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521779.424783:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521779.424804:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb19173c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521779.426773:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816906880 00000100:00100000:0.0:1788521779.426786:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816906880 00000100:00100000:0.0:1788521779.426838:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788521779.426847:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:5830:x1875400816906880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521779.427528:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:5830:x1875400816906880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 681us (2743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521779.427537:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788521779.428002:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816906880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521779.428050:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816907008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521779.428111:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521779.428164:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb19173c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521779.428180:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816907008 00000100:00100000:3.0:1788521779.428184:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816907008 00000100:00100000:3.0:1788521779.428213:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788521779.428220:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:5830:x1875400816907008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521779.428370:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:5830:x1875400816907008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521779.428378:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788521779.428413:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816907008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521779.428570:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:11683:1875400816907136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521779.428603:0:11683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521779.428621:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816907136 00000100:00100000:3.0:1788521779.428624:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816907136 00000100:00100000:3.0:1788521779.428640:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788521779.428645:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:11683:x1875400816907136:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521779.428978:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:11683:x1875400816907136:12345-0@lo:502:llog_process_th.0 Request processed in 331us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521779.428985:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788521779.429013:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86745780 going to sleep for 11 seconds 00000100:00100000:3.0:1788521779.429027:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:11683:1875400816907136:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788521779.429046:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521779.429054:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521779.429057:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788521779.429063:0:11683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff996f97fff000 00000020:00000080:3.0:1788521779.429065:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000040:00080000:0.0:1788521779.429866:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788521779.430023:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:11683:1875400816907264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521779.430073:0:11683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521779.430818:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816907264 00000100:00100000:3.0:1788521779.430826:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816907264 00000100:00100000:3.0:1788521779.430864:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788521779.430872:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:11683:x1875400816907264:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521779.431056:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:11683:x1875400816907264:12345-0@lo:502:llog_process_th.0 Request processed in 183us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521779.431063:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788521779.433240:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86745780 going to sleep for 11 seconds 00000100:00100000:2.0:1788521779.433280:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:11683:1875400816907264:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788521779.433317:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521779.433324:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521779.433327:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788521779.433331:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788521779.433447:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788521779.433463:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788521779.433472:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490b400/0x1b7b50db5927be8c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927be93 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521779.433483:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996fb490b400/0x1b7b50db5927be8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927be93 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521779.433493:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788521779.433496:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff996f85616000 from 7 10000000:01000000:2.0:1788521779.433499:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788521779.433530:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490ba00/0x1b7b50db5927be9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521779.433538:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996fb490ba00/0x1b7b50db5927be9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521779.433547:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996fb490ba00/0x1b7b50db5927be9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521779.433566:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816907392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788521779.433620:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521779.433643:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb47d3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521779.433666:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816907392 00000100:00100000:2.0:1788521779.433671:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816907392 00000100:00100000:2.0:1788521779.433736:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788521779.433745:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:5830:x1875400816907392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521779.433757:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521779.433767:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996fb490a000/0x1b7b50db5927bea1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927be9a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521779.433790:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fb490a000/0x1b7b50db5927bea1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927be9a expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521779.433800:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996fb490a000/0x1b7b50db5927bea1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927be9a expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521779.433808:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490a000, rc 0) 00000100:00100000:2.0:1788521779.433843:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:5830:x1875400816907392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521779.433849:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788521779.433883:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816907392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521779.433896:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996fb490ba00/0x1b7b50db5927be9a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bea1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521779.433905:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996fb490ba00/0x1b7b50db5927be9a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bea1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521779.433948:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816907520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521779.433973:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521779.433986:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb47d3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521779.433998:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816907520 00000100:00100000:2.0:1788521779.434002:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816907520 00000100:00100000:2.0:1788521779.434028:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788521779.434033:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:5830:x1875400816907520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521779.434289:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:5830:x1875400816907520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521779.434296:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788521779.434325:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816907520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521779.434350:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816907648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521779.434383:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521779.434397:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb47d3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521779.434409:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816907648 00000100:00100000:2.0:1788521779.434413:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816907648 00000100:00100000:2.0:1788521779.434428:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788521779.434434:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:5830:x1875400816907648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521779.434562:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:5830:x1875400816907648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521779.434568:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788521779.434601:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:5830:1875400816907648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521779.434767:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:11684:1875400816907776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521779.434800:0:11684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521779.434818:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816907776 00000100:00100000:2.0:1788521779.434822:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816907776 00000100:00100000:2.0:1788521779.434842:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788521779.434848:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86014c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:11684:x1875400816907776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521779.434964:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86014c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:11684:x1875400816907776:12345-0@lo:502:llog_process_th.0 Request processed in 115us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521779.434977:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788521779.435004:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb47d3180 going to sleep for 11 seconds 00000100:00100000:2.0:1788521779.435015:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:11684:1875400816907776:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788521779.435035:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521779.435042:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521779.435044:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788521779.435050:0:11684:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff996f85616000 00000020:00000080:2.0:1788521779.435053:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788521779.435385:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:11684:1875400816907904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521779.435427:0:11684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521779.435450:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f867453c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521779.438264:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816907904 00000100:00100000:2.0:1788521779.438277:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816907904 00000100:00100000:2.0:1788521779.438328:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788521779.438337:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:11684:x1875400816907904:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521779.438583:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:11684:x1875400816907904:12345-0@lo:502:llog_process_th.0 Request processed in 247us (3155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521779.438590:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788521779.442425:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:11684:1875400816907904:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788521779.442469:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788521779.442478:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521779.442480:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788521779.442485:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788521779.443508:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788521779.443531:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788521779.443541:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490ba00/0x1b7b50db5927be9a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bea1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521779.443553:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996fb490ba00/0x1b7b50db5927be9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bea1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521779.913857:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521779.913982:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799048320 00000100:00100000:0.0:1788521779.913992:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799048320 00000100:00100000:0.0:1788521779.914040:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 258 00000100:00100000:0.0:1788521779.914049:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+11:5600:x1875400799048320:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521779.914072:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521779.914090:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996fc217d400/0x1b7b50db5927bea8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00970 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521779.914131:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fc217d400/0x1b7b50db5927bea8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00970 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521779.914170:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996fc217d400/0x1b7b50db5927bea8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00970 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521779.914180:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fc217d400, rc 0) 00000100:00100000:0.0:1788521779.914238:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86010450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+12:5600:x1875400799048320:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 Request processed in 190us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521779.914245:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 258 00000100:00100000:3.0:1788521779.924096:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521779.924262:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799048448 00000100:00100000:2.0:1788521779.924275:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799048448 00000100:00100000:2.0:1788521779.924355:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 259 00000100:00100000:2.0:1788521779.924367:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+12:5600:x1875400799048448:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521779.924763:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+12:5600:x1875400799048448:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 Request processed in 396us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521779.924772:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 259 00000100:00100000:2.0:1788521779.928873:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521779.928988:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799048576 00000100:00100000:0.0:1788521779.929001:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799048576 00000100:00100000:0.0:1788521779.929067:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 260 00000100:00100000:0.0:1788521779.929079:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+12:5600:x1875400799048576:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521779.929421:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+12:5600:x1875400799048576:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 Request processed in 341us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521779.929431:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 260 00000100:00100000:3.0:1788521779.933704:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521779.934254:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799048704 00000100:00100000:0.0:1788521779.934266:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799048704 00000100:00100000:0.0:1788521779.934339:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 261 00000100:00100000:0.0:1788521779.934351:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+12:9949:x1875400799048704:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788521779.934708:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+12:9949:x1875400799048704:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 358us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521779.934831:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 261 00000100:00100000:3.0:1788521779.945203:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521779.945908:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799048832 00000100:00100000:2.0:1788521779.945923:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799048832 00000100:00100000:2.0:1788521779.945992:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 262 00000100:00100000:2.0:1788521779.946014:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+12:9949:x1875400799048832:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788521779.946352:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86012450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+12:9949:x1875400799048832:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 339us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521779.946361:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 262 00000100:00100000:1.0:1788521779.963451:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521779.964187:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799048960 00000100:00100000:3.0:1788521779.964202:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799048960 00000100:00100000:3.0:1788521779.964279:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 263 00000100:00100000:3.0:1788521779.964291:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+12:5600:x1875400799048960:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521779.964312:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521779.964334:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f8392c000/0x1b7b50db5927beaf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00977 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521779.964379:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8392c000/0x1b7b50db5927beaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00977 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521779.964392:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f8392c000/0x1b7b50db5927beaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00977 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521779.964404:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392c000, rc 0) 00000100:00100000:3.0:1788521779.964489:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86013450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+13:5600:x1875400799048960:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 Request processed in 200us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521779.964496:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 263 00000100:00100000:2.0:1788521779.976211:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521779.976485:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799049088 00000100:00100000:0.0:1788521779.976514:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799049088 00000100:00100000:0.0:1788521779.976582:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 264 00000100:00100000:0.0:1788521779.976594:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+13:5600:x1875400799049088:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521779.977715:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86011050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+13:5600:x1875400799049088:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 Request processed in 1107us (1504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521779.977729:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 264 00000100:00100000:0.0:1788521779.981294:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521779.981555:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799049216 00000100:00100000:2.0:1788521779.981568:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799049216 00000100:00100000:2.0:1788521779.984706:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 265 00000100:00100000:2.0:1788521779.984747:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+13:5600:x1875400799049216:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521779.985083:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86012850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+13:5600:x1875400799049216:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 Request processed in 354us (3804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521779.985092:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 265 00000100:00100000:1.0:1788521779.992067:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521779.992455:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799049344 00000100:00100000:0.0:1788521779.992539:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799049344 00000100:00100000:0.0:1788521779.992658:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 266 00000100:00100000:0.0:1788521779.992670:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+13:9952:x1875400799049344:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788521779.993226:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86013050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+13:9952:x1875400799049344:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 556us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521779.993237:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 266 00000100:00100000:0.0:1788521779.998642:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521779.998781:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799049472 00000100:00100000:2.0:1788521779.998795:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799049472 00000100:00100000:2.0:1788521779.998871:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 267 00000100:00100000:2.0:1788521779.998884:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+13:9952:x1875400799049472:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788521779.999238:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86010c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+13:9952:x1875400799049472:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 355us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521779.999248:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 267 00010000:00010000:2.0:1788521780.366342:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788521780.431180:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788521780.491964:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521780.492074:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521780.492116:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521780.492301:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799049600 00000100:00100000:3.0:1788521780.492311:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799049600 00000100:00100000:3.0:1788521780.492374:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799049856 00000100:00100000:3.0:1788521780.492378:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799049856 00000100:00100000:3.0:1788521780.492401:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 93 00000100:00100000:3.0:1788521780.492411:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2364:x1875400799049600:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521780.492484:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2364:x1875400799049600:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 74us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521780.492491:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 93 00000100:00100000:3.0:1788521780.492510:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 94 00000100:00100000:3.0:1788521780.492532:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb46d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2364:x1875400799049856:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521780.492573:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb46d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2364:x1875400799049856:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 43us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521780.492579:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 94 00000100:00080000:1.0:1788521780.493130:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521780.497096:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799049728 00000100:00100000:2.0:1788521780.497110:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799049728 00000100:00100000:2.0:1788521780.497392:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 52 00000100:00100000:2.0:1788521780.497403:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2363:x1875400799049728:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521780.497483:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2363:x1875400799049728:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 83us (5543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521780.497502:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 52 00000100:00080000:1.0:1788521780.498022:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521780.558382:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788521780.558406:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816908032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521780.558484:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521780.558919:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816908032 00000100:00100000:0.0:1788521780.558927:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816908032 00000100:00100000:0.0:1788521780.559001:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788521780.559010:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875400816908032:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788521780.559037:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788521780.559043:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521780.559098:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875400816908032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521780.559105:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788521780.559304:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816908032:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788521781.393292:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521782.414457:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788521783.206968:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:2.0:1788521783.439176:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521783.635877:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875400816908416:0@lo:400:kworker.0 00000100:00100000:0.0:1788521783.635941:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521783.635988:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816908288:0@lo:400:kworker.0 00000100:00100000:2.0:1788521783.636028:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521783.636052:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816908800:0@lo:400:kworker.0 00000100:00100000:1.0:1788521783.636077:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816908544:0@lo:400:kworker.0 00000100:00100000:2.0:1788521783.636084:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521783.636117:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521783.636168:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816908160:0@lo:400:kworker.0 00000100:00100000:3.0:1788521783.636199:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521783.636224:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875400816908672:0@lo:400:kworker.0 00000100:00100000:3.0:1788521783.636249:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521783.636321:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816908800 00000100:00100000:1.0:1788521783.636328:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816908800 00000100:00100000:1.0:1788521783.636388:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816908544 00000100:00100000:1.0:1788521783.636392:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816908544 00000100:00100000:1.0:1788521783.636413:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788521783.636422:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816908800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521783.636471:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816908800:12345-0@lo:400:kworker.0 Request processed in 50us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521783.636478:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788521783.636494:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788521783.636501:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb46d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816908544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521783.636531:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb46d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816908544:12345-0@lo:400:kworker.0 Request processed in 31us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521783.636537:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788521783.636553:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788521783.636556:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788521783.636576:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1788521783.636582:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff996f85dc3b80, transno 4294967300 00000100:00100000:1.0:1788521783.636594:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816908544:0@lo:400:kworker.0 00000100:00100000:1.0:1788521783.636627:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816908160 00000100:00100000:1.0:1788521783.636631:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816908160 00000100:00100000:1.0:1788521783.636654:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788521783.636676:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3307:x1875400816908160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521783.636708:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86012050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3307:x1875400816908160:12345-0@lo:400:kworker.0 Request processed in 48us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521783.636714:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00010000:00080000:1.0:1788521783.636779:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb7f41f80 x1875400816908800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521783.636796:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816908800:0@lo:400:kworker.0 00000100:00100000:0.0:1788521783.638925:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816908416 00000100:00100000:0.0:1788521783.638940:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816908416 00000100:00100000:0.0:1788521783.639007:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816908288 00000100:00100000:0.0:1788521783.639010:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816908288 00000100:00100000:0.0:1788521783.639035:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788521783.639043:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875400816908416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521783.639125:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875400816908416:12345-0@lo:400:kworker.0 Request processed in 82us (3183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521783.639131:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788521783.639166:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788521783.639172:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816908288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521783.639208:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816908288:12345-0@lo:400:kworker.0 Request processed in 37us (3182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521783.639214:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788521783.639264:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875400816908416:0@lo:400:kworker.0 00000100:00100000:0.0:1788521783.639299:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816908288:0@lo:400:kworker.0 00000100:00080000:1.0:1788521783.639389:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521783.647690:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816908672 00000100:00100000:3.0:1788521783.647696:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816908160:0@lo:400:kworker.0 00000100:00100000:0.0:1788521783.647702:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816908672 00000100:00100000:0.0:1788521783.647837:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788521783.647847:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875400816908672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521783.647924:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875400816908672:12345-0@lo:400:kworker.0 Request processed in 79us (11674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521783.647932:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788521783.647991:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875400816908672:0@lo:400:kworker.0 00000100:00080000:1.0:1788521783.648119:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521784.143116:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816908928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521784.143217:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521784.145039:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816908928 00000100:00100000:0.0:1788521784.145052:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816908928 00000100:00100000:0.0:1788521784.145125:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788521784.145136:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816908928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788521784.145210:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521784.145285:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816908928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (2069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521784.145293:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1788521784.145429:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb7f41500 x1875400816908928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521784.145448:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816908928:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788521784.462718:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521785.486379:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521785.610678:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521785.610767:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521785.610809:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521785.610844:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521785.610944:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799050240 00000100:00100000:2.0:1788521785.610954:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799050240 00000100:00100000:2.0:1788521785.611033:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 55 00000100:00100000:2.0:1788521785.611044:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadb3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2363:x1875400799050240:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521785.611128:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadb3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2363:x1875400799050240:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 86us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521785.611135:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 55 00000100:00100000:2.0:1788521785.611284:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799050112 00000100:00100000:2.0:1788521785.611288:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799050112 00000100:00100000:2.0:1788521785.611321:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799050368 00000100:00100000:2.0:1788521785.611325:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799050368 00000100:00100000:2.0:1788521785.611357:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 98 00000100:00100000:2.0:1788521785.611371:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2363:x1875400799050112:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521785.611415:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2363:x1875400799050112:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 51us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521785.611421:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 98 00000100:00100000:2.0:1788521785.611451:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 99 00000100:00100000:2.0:1788521785.611457:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2363:x1875400799050368:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521785.611480:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2363:x1875400799050368:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 24us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521785.611485:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 99 00000100:00100000:3.0:1788521785.611994:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799049984 00000100:00100000:3.0:1788521785.612000:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799049984 00000100:00100000:3.0:1788521785.612044:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 269 00000100:00100000:3.0:1788521785.612055:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+13:2363:x1875400799049984:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521785.612095:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+13:2363:x1875400799049984:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 42us (1424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521785.612113:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 269 00000100:00080000:1.0:1788521785.613728:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788521785.613736:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521785.682322:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816909056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788521785.682392:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521785.682506:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816909056 00000100:00100000:0.0:1788521785.682524:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816909056 00000100:00100000:0.0:1788521785.682587:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788521785.682596:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb45a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816909056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788521785.682627:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788521785.682772:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521785.683058:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb45a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816909056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 463us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521785.683067:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788521785.683588:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816909056:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788521786.510439:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521787.534410:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521788.560861:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521788.751556:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816909568:0@lo:400:kworker.0 00000100:00100000:1.0:1788521788.751623:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521788.751693:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788521788.751700:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb45a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816909184:0@lo:400:kworker.0 00000100:00100000:1.0:1788521788.751732:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521788.751754:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875400816909696:0@lo:400:kworker.0 00000100:00100000:1.0:1788521788.751779:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521788.751805:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816909312:0@lo:400:kworker.0 00000100:00100000:1.0:1788521788.751830:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521788.751847:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816909824:0@lo:400:kworker.0 00000100:00100000:1.0:1788521788.751911:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521788.751930:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788521788.751935:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875400816909440:0@lo:400:kworker.0 00000100:00100000:1.0:1788521788.751957:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521788.751989:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816909568 00000100:00100000:1.0:1788521788.751996:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816909568 00000100:00100000:1.0:1788521788.752040:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816909824 00000100:00100000:1.0:1788521788.752043:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816909824 00000100:00100000:1.0:1788521788.752080:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788521788.752088:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbcb31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816909568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521788.752136:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbcb31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816909568:12345-0@lo:400:kworker.0 Request processed in 47us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521788.752161:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788521788.752176:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788521788.752183:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816909824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521788.752215:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816909824:12345-0@lo:400:kworker.0 Request processed in 33us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521788.752221:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788521788.752240:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816909184 00000100:00100000:1.0:1788521788.752244:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816909184 00000100:00100000:1.0:1788521788.752262:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788521788.752268:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3306:x1875400816909184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521788.752295:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86013c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3306:x1875400816909184:12345-0@lo:400:kworker.0 Request processed in 27us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521788.752423:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788521788.752454:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816909696 00000100:00100000:1.0:1788521788.752458:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816909696 00000100:00100000:1.0:1788521788.752495:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816909312 00000100:00100000:1.0:1788521788.752498:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816909312 00000100:00100000:1.0:1788521788.752509:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816909440 00000100:00100000:1.0:1788521788.752511:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816909440 00000100:00100000:1.0:1788521788.752524:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788521788.752529:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbcb32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875400816909696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521788.752560:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbcb32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875400816909696:12345-0@lo:400:kworker.0 Request processed in 30us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521788.752565:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788521788.752578:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788521788.752585:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816909312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521788.752612:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816909312:12345-0@lo:400:kworker.0 Request processed in 27us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521788.752617:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788521788.752627:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788521788.752642:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875400816909440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521788.752668:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875400816909440:12345-0@lo:400:kworker.0 Request processed in 36us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521788.752675:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1788521788.752692:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788521788.752696:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788521788.752699:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521788.752728:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb45a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3306:1875400816909184:0@lo:400:kworker.0 00000100:00100000:1.0:1788521788.752744:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875400816909696:0@lo:400:kworker.0 00000100:00100000:1.0:1788521788.752753:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816909568:0@lo:400:kworker.0 00000100:00100000:1.0:1788521788.752785:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875400816909440:0@lo:400:kworker.0 00000100:00100000:1.0:1788521788.752805:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816909312:0@lo:400:kworker.0 00010000:00080000:1.0:1788521788.752816:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fbcb30a80 x1875400816909824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521788.752826:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816909824:0@lo:400:kworker.0 00000100:00100000:1.0:1788521789.264006:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816909952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521789.264076:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521789.264301:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816909952 00000100:00100000:3.0:1788521789.264309:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816909952 00000100:00100000:3.0:1788521789.264356:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788521789.264365:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816909952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788521789.264398:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521789.264448:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816909952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521789.264454:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1788521789.264531:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb7f40e00 x1875400816909952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521789.264549:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816909952:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788521789.583372:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521790.606376:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788521790.670894:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788521790.733971:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521790.734013:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521790.734043:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521790.734070:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521790.734175:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799050624 00000100:00100000:0.0:1788521790.734185:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799050624 00000100:00100000:3.0:1788521790.734188:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799050880 00000100:00100000:3.0:1788521790.734195:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799050880 00000100:00100000:1.0:1788521790.734264:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799050496 00000100:00100000:0.0:1788521790.734269:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 103 00000100:00100000:1.0:1788521790.734271:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799050496 00000100:00100000:0.0:1788521790.734282:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2364:x1875400799050624:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521790.734310:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 271 00000100:00100000:1.0:1788521790.734318:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+13:2364:x1875400799050496:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521790.734356:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2364:x1875400799050624:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 75us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521790.734357:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+13:2364:x1875400799050496:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 37us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521790.734376:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 103 00000100:00100000:1.0:1788521790.734377:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 271 00000100:00100000:1.0:1788521790.734412:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799050752 00000100:00100000:1.0:1788521790.734417:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799050752 00000100:00100000:3.0:1788521790.734885:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 104 00000100:00100000:3.0:1788521790.734892:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2364:x1875400799050880:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521790.734927:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2364:x1875400799050880:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 36us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521790.734933:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 104 00000100:00100000:1.0:1788521790.735006:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 58 00000100:00100000:1.0:1788521790.735012:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2364:x1875400799050752:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521790.735040:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2364:x1875400799050752:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 28us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521790.735061:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 58 00000100:00080000:2.0:1788521790.736473:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788521790.736481:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521790.800333:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816910080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788521790.800397:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521790.800530:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816910080 00000100:00100000:2.0:1788521790.800538:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816910080 00000100:00100000:2.0:1788521790.800596:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788521790.800605:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816910080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788521790.800651:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521790.800690:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816910080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521790.800697:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788521790.804105:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816910080:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788521790.805097:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788521791.630665:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521792.654605:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521793.678452:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521793.870466:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816910336:0@lo:400:kworker.0 00000100:00100000:0.0:1788521793.870536:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521793.870561:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875400816910464:0@lo:400:kworker.0 00000100:00100000:1.0:1788521793.870598:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521793.870627:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816910848:0@lo:400:kworker.0 00000100:00100000:1.0:1788521793.870662:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816910336 00000100:00100000:1.0:1788521793.870669:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816910336 00000100:00100000:3.0:1788521793.870706:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816910208:0@lo:400:kworker.0 00000100:00100000:1.0:1788521793.870715:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816910464 00000100:00100000:1.0:1788521793.870720:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816910464 00000100:00100000:3.0:1788521793.870748:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521793.870778:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875400816910720:0@lo:400:kworker.0 00000100:00100000:0.0:1788521793.870793:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521793.870811:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788521793.870944:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521793.871485:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816910720 00000100:00100000:1.0:1788521793.871490:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816910720 00000100:00100000:3.0:1788521793.871507:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788521793.871518:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816910592:0@lo:400:kworker.0 00000100:00100000:1.0:1788521793.871535:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788521793.871546:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816910336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521793.871554:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521793.871620:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788521793.871623:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816910336:12345-0@lo:400:kworker.0 Request processed in 77us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521793.871624:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816910208 00000100:00100000:3.0:1788521793.871631:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816910208 00000100:00100000:2.0:1788521793.871637:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788521793.871643:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788521793.871649:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875400816910720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521793.871668:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788521793.871674:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816910848 00000100:00100000:3.0:1788521793.871680:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f86012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3307:x1875400816910208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521793.871680:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816910848 00000100:00100000:2.0:1788521793.871691:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875400816910720:12345-0@lo:400:kworker.0 Request processed in 45us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521793.871705:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788521793.871706:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816910592 00000100:00100000:1.0:1788521793.871709:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816910592 00000100:00100000:3.0:1788521793.871729:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f86012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3307:x1875400816910208:12345-0@lo:400:kworker.0 Request processed in 51us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521793.871732:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788521793.871739:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788521793.871740:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816910848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521793.871745:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788521793.871746:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816910592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521793.871788:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816910592:12345-0@lo:400:kworker.0 Request processed in 41us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521793.871794:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788521793.871808:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816910592:0@lo:400:kworker.0 00000100:00100000:3.0:1788521793.871822:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816910208:0@lo:400:kworker.0 00000100:00080000:2.0:1788521793.871826:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788521793.871831:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521793.871834:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521793.871837:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875400816910720:0@lo:400:kworker.0 00000100:00100000:2.0:1788521793.871857:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816910336:0@lo:400:kworker.0 00000100:00100000:1.0:1788521793.871863:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816910848:12345-0@lo:400:kworker.0 Request processed in 123us (1072us total) trans 0 rc 0/0 00010000:00080000:2.0:1788521793.871875:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996f85dc1500 x1875400816910848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521793.871884:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875400816910464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521793.871887:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816910848:0@lo:400:kworker.0 00000100:00100000:0.0:1788521793.871937:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875400816910464:12345-0@lo:400:kworker.0 Request processed in 299us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521793.871945:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788521793.871951:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875400816910464:0@lo:400:kworker.0 00000100:00100000:1.0:1788521793.872080:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788521794.383685:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788521794.387396:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816910976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521794.387589:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521794.389714:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816910976 00000100:00100000:2.0:1788521794.389727:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816910976 00000100:00100000:2.0:1788521794.389788:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788521794.389799:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816910976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788521794.389844:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521794.390129:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816910976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 332us (2539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521794.390137:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1788521794.392193:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb7f42a00 x1875400816910976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521810 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521794.392232:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816910976:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788521794.702843:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521795.728447:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521795.851676:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521795.851737:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521795.852400:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799051008 00000100:00100000:0.0:1788521795.852412:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799051008 00000100:00100000:0.0:1788521795.852645:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 273 00000100:00100000:0.0:1788521795.852656:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+13:2362:x1875400799051008:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521795.852730:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+13:2362:x1875400799051008:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 76us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521795.852738:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 273 00000100:00100000:2.0:1788521795.853001:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799051136 00000100:00100000:2.0:1788521795.853018:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799051136 00000100:00100000:2.0:1788521795.853072:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 108 00000100:00100000:2.0:1788521795.853081:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2362:x1875400799051136:12345-192.168.206.48@tcp:400:kworker.0 00000100:00080000:0.0:1788521795.853190:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521795.856277:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2362:x1875400799051136:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 3185us (4528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521795.856292:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 108 00000100:00100000:1.0:1788521795.871911:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521795.872024:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521795.873178:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799051392 00000100:00100000:2.0:1788521795.873190:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799051392 00000100:00100000:2.0:1788521795.873288:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 109 00000100:00100000:2.0:1788521795.873299:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbcb32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2361:x1875400799051392:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521795.873372:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbcb32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2361:x1875400799051392:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 75us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521795.873379:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 109 00000100:00080000:0.0:1788521795.874019:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521795.874136:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799051264 00000100:00100000:3.0:1788521795.874158:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799051264 00000100:00080000:0.0:1788521795.874214:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521795.874220:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:3.0:1788521795.874336:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbcb30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2360:x1875400799051264:12345-192.168.206.48@tcp:9:kworker.0 00000020:00000080:3.0:1788521795.874361:0:11097:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927bdeb 00000100:00080000:3.0:1788521795.874370:0:11097:0:(import.c:65:import_set_state_nolock()) ffff996fad74f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788521795.874451:0:11097:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1788521795.874727:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbcb30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+2:2360:x1875400799051264:12345-192.168.206.48@tcp:9:kworker.0 Request processed in 496us (2824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521795.874933:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 19 00010000:00010000:1.0:1788521795.875608:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521795.920231:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788521795.920414:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816911104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521795.920483:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521795.920675:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816911104 00000100:00100000:0.0:1788521795.920683:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816911104 00000100:00100000:0.0:1788521795.920740:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788521795.920750:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816911104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788521795.920783:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521795.920825:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816911104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521795.920831:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1788521795.921176:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521795.921226:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816911104:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788521796.751202:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521797.774496:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788521798.533537:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4bd13e8f-aac9-42ad-8625-a542705d6920 00000020:00000080:1.0:1788521798.533547:0:6713:0:(genops.c:885:class_export_put()) final put ffff996fad748800/4bd13e8f-aac9-42ad-8625-a542705d6920 00000020:00000080:1.0:1788521798.533575:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff996fad748800/4bd13e8f-aac9-42ad-8625-a542705d6920 for lustre-OST0000 00000020:00000080:1.0:1788521798.533627:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff996fad74f800 for lustre-OST0000 00010000:00010000:1.0:1788521798.801721:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521798.990430:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875400816911488:0@lo:400:kworker.0 00000100:00100000:0.0:1788521798.990430:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816911616:0@lo:400:kworker.0 00000100:00100000:3.0:1788521798.990470:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816911232:0@lo:400:kworker.0 00000100:00100000:2.0:1788521798.991460:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521798.991518:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788521798.991528:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875400816911360:0@lo:400:kworker.0 00000100:00100000:2.0:1788521798.991761:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521798.991784:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816911872:0@lo:400:kworker.0 00000100:00100000:2.0:1788521798.991818:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521798.991854:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816911488 00000100:00100000:2.0:1788521798.991861:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816911488 00000100:00100000:2.0:1788521798.991906:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816911360 00000100:00100000:2.0:1788521798.991909:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816911360 00000100:00100000:2.0:1788521798.991934:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788521798.991944:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875400816911488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521798.992001:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875400816911488:12345-0@lo:400:kworker.0 Request processed in 58us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521798.992009:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788521798.992028:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788521798.992035:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875400816911360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521798.992067:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875400816911360:12345-0@lo:400:kworker.0 Request processed in 34us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521798.992072:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788521798.992096:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816911872 00000100:00100000:2.0:1788521798.992100:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816911872 00000100:00100000:2.0:1788521798.992131:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788521798.992138:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816911872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521798.992193:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521798.992235:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816911616 00000100:00100000:0.0:1788521798.992239:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816911616 00000100:00100000:0.0:1788521798.992266:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788521798.992281:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816911616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521798.992321:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816911616:12345-0@lo:400:kworker.0 Request processed in 41us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521798.992329:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788521798.992354:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816911872:12345-0@lo:400:kworker.0 Request processed in 216us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521798.992363:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788521798.992377:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816911616:0@lo:400:kworker.0 00000100:00080000:2.0:1788521798.992382:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788521798.992386:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521798.992389:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521798.992422:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875400816911360:0@lo:400:kworker.0 00010000:00080000:2.0:1788521798.992436:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996f85dc0700 x1875400816911872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521798.992454:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816911872:0@lo:400:kworker.0 00000100:00100000:2.0:1788521798.992466:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875400816911488:0@lo:400:kworker.0 00000100:00100000:0.0:1788521798.998442:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521798.998508:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875400816911744:0@lo:400:kworker.0 00000100:00100000:0.0:1788521798.998545:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521798.998658:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816911232 00000100:00100000:2.0:1788521798.998667:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816911232 00000100:00100000:2.0:1788521798.998713:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788521798.998723:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3307:x1875400816911232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521798.998770:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3307:x1875400816911232:12345-0@lo:400:kworker.0 Request processed in 48us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521798.998778:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788521799.000017:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816911232:0@lo:400:kworker.0 00000100:00100000:3.0:1788521799.007042:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816911744 00000100:00100000:3.0:1788521799.007078:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816911744 00000100:00100000:0.0:1788521799.007252:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788521799.007264:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875400816911744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521799.007357:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875400816911744:12345-0@lo:400:kworker.0 Request processed in 96us (8811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521799.007365:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:2.0:1788521799.007443:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521799.007510:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875400816911744:0@lo:400:kworker.0 00000100:00100000:1.0:1788521799.503277:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816912000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521799.503343:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521799.505515:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816912000 00000100:00100000:0.0:1788521799.505526:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816912000 00000100:00100000:0.0:1788521799.505590:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788521799.505599:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbcb31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816912000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788521799.505633:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521799.505701:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbcb31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816912000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (2357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521799.505708:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1788521799.505752:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fb7f41c00 x1875400816912000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521815 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521799.505771:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816912000:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788521799.823277:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521800.846789:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788521800.911274:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788521800.983353:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521800.983400:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521800.983434:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521800.983667:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799051776 00000100:00100000:2.0:1788521800.983691:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799051776 00000100:00100000:2.0:1788521800.983759:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799051648 00000100:00100000:2.0:1788521800.983763:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799051648 00000100:00100000:3.0:1788521800.983771:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 113 00000100:00100000:2.0:1788521800.983790:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 114 00000100:00100000:3.0:1788521800.983802:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbcb33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2363:x1875400799051776:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521800.983802:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbcb31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2363:x1875400799051648:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521800.983880:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbcb33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2363:x1875400799051776:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 98us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521800.983887:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 113 00000100:00100000:0.0:1788521800.983916:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799051520 00000100:00100000:0.0:1788521800.983921:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799051520 00000100:00100000:0.0:1788521800.983954:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 275 00000100:00100000:0.0:1788521800.983963:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+13:2363:x1875400799051520:12345-192.168.206.48@tcp:400:kworker.0 00000100:00080000:1.0:1788521800.983967:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521800.984763:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbcb31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2363:x1875400799051648:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 960us (1323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521800.984772:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 114 00000100:00100000:0.0:1788521801.008754:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+13:2363:x1875400799051520:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 24779us (25396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521801.008768:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 275 00000100:00100000:3.0:1788521801.040625:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788521801.040647:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816912128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521801.040715:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521801.041387:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816912128 00000100:00100000:0.0:1788521801.041395:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816912128 00000100:00100000:0.0:1788521801.041478:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788521801.041488:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816912128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788521801.041522:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788521801.041619:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521801.041842:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816912128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 355us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521801.041851:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788521801.041899:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816912128:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788521801.771861:0:11849:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 07:36:40 (1788521800) 00010000:00010000:3.0:1788521801.875841:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521802.894793:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521803.065098:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521803.065186:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799051904 00000100:00100000:3.0:1788521803.065196:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799051904 00000100:00100000:3.0:1788521803.065268:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 32 00000100:00100000:3.0:1788521803.065282:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb45a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+5:10219:x1875400799051904:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521803.065302:0:10083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521803.065324:0:10083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927beb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd0097e expref: -99 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788521803.065462:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788521803.065471:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927bebd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521803.065487:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927bebd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521803.065516:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927bebd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521803.065551:0:10083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788521803.065554:0:10083:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521803.065600:0:10083:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927bebd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521803.065626:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927beb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0097e expref: 7 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521803.065643:0:10083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927bebd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0097e expref: 6 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521803.065652:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996f8687ec00) 00010000:00010000:2.0:1788521803.065655:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788521803.065658:0:10083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490a400, rc 0) 00000100:00100000:2.0:1788521803.065758:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb45a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+6:10219:x1875400799051904:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 480us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521803.065766:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 32 00000100:00100000:2.0:1788521803.084080:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521803.084177:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799052032 00000100:00100000:1.0:1788521803.084188:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799052032 00000100:00100000:1.0:1788521803.084257:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:1.0:1788521803.084268:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+6:10220:x1875400799052032:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788521803.084291:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521803.084311:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927bec4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00985 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521803.084389:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927becb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521803.084404:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927becb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521803.084415:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927becb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521803.084433:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927bed2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521803.084440:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927bed2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521803.084446:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927bed2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521803.084766:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4c00/0x1b7b50db5927bed9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521803.084776:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4c00/0x1b7b50db5927bed9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521803.084783:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4c00/0x1b7b50db5927bed9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521803.084806:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788521803.084810:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521803.084829:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4c00/0x1b7b50db5927bed9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521803.084848:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927becb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521803.084855:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927becb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521803.084862:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927becb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521803.084867:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521803.084872:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927becb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521803.084879:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927becb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521803.084890:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996f8687ec00) 00010000:00010000:1.0:1788521803.084893:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521803.084901:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927becb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521803.084907:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927becb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521803.084920:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927bed2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521803.084926:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927bed2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521803.084932:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927bed2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521803.084942:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521803.084945:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927bed2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521803.084953:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927bed2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521803.084961:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff996fa0d5c200) 00010000:00010000:1.0:1788521803.084963:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521803.084966:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927bed2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521803.084971:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927bed2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521803.085006:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927bec4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00985 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521803.085019:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4c00/0x1b7b50db5927bed9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00985 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521803.085027:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff996fa0d5ce00) 00010000:00010000:1.0:1788521803.085029:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788521803.085031:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d4c00, rc 0) 00000100:00100000:1.0:1788521803.085214:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+7:10220:x1875400799052032:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 947us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521803.085222:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:3.0:1788521803.091988:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521803.094090:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799052288 00000100:00100000:2.0:1788521803.094105:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799052288 00000100:00100000:2.0:1788521803.094186:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 34 00000100:00100000:2.0:1788521803.094197:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+7:10220:x1875400799052288:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521803.094216:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521803.094237:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927bee0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd0098c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521803.094323:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927bee7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521803.094339:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927bee7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521803.094351:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927bee7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521803.094677:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927beee lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521803.094687:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927beee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521803.094694:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927beee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521803.095414:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b800/0x1b7b50db5927bef5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521803.095426:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b800/0x1b7b50db5927bef5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521803.095434:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b800/0x1b7b50db5927bef5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521803.095444:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788521803.097578:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927bee7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521803.097772:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927bee7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521803.097793:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927bee7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521803.097799:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490a200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521803.097803:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927bee7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521803.097812:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927bee7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521803.097829:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff996fa0d5ce00) 00010000:00010000:2.0:1788521803.097832:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521803.097838:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927bee7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521803.097845:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927bee7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521803.097861:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927beee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521803.097867:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927beee lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521803.097873:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927beee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521803.097878:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490aa00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521803.097881:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927beee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521803.097899:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927beee lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521803.097908:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff996fb19efd00) 00010000:00010000:2.0:1788521803.097910:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521803.097914:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927beee lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521803.097919:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927beee lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521803.099509:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927bee0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0098c expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521803.099532:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b800/0x1b7b50db5927bef5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0098c expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521803.099541:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996fb19efc00) 00010000:00010000:2.0:1788521803.099544:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521803.099547:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490b800, rc 0) 00000100:00100000:2.0:1788521803.099747:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+9:10220:x1875400799052288:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 5551us (7945us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788521803.099757:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 34 00000100:00100000:3.0:1788521803.112069:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521803.112174:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799052416 00000100:00100000:1.0:1788521803.112194:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799052416 00000100:00100000:1.0:1788521803.112252:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 35 00000100:00100000:1.0:1788521803.112262:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+9:10220:x1875400799052416:12345-192.168.206.48@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788521803.112363:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+9:10220:x1875400799052416:12345-192.168.206.48@tcp:59:lhsmtool_posix.0 Request processed in 102us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521803.112371:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 35 00000001:00080000:0.0:1788521803.642727:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:2.0:1788521803.920645:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788521803.983037:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788521804.110629:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc3eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875400816912512:0@lo:400:kworker.0 00000100:00100000:2.0:1788521804.110710:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521804.110774:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788521804.110795:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc3ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875400816912384:0@lo:400:kworker.0 00000100:00100000:2.0:1788521804.110816:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521804.110831:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc3efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816912896:0@lo:400:kworker.0 00000100:00100000:2.0:1788521804.110852:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521804.110884:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816912512 00000100:00100000:2.0:1788521804.110892:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816912512 00000100:00100000:2.0:1788521804.110951:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816912384 00000100:00100000:2.0:1788521804.110954:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816912384 00000100:00100000:2.0:1788521804.110976:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788521804.110984:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875400816912512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521804.111047:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875400816912512:12345-0@lo:400:kworker.0 Request processed in 64us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521804.111055:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788521804.111072:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788521804.111078:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875400816912384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521804.111099:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875400816912384:12345-0@lo:400:kworker.0 Request processed in 22us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521804.111105:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788521804.111125:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816912896 00000100:00100000:2.0:1788521804.111128:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816912896 00000100:00100000:2.0:1788521804.111183:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788521804.111189:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816912896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521804.111215:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816912896:12345-0@lo:400:kworker.0 Request processed in 27us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521804.111221:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1788521804.111235:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521804.111239:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521804.111293:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc3ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875400816912384:0@lo:400:kworker.0 00010000:00080000:2.0:1788521804.111307:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fbc3efb80 x1875400816912896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521804.111318:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc3efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816912896:0@lo:400:kworker.0 00000100:00100000:2.0:1788521804.111328:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc3eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875400816912512:0@lo:400:kworker.0 00000100:00100000:0.0:1788521804.111436:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816912256:0@lo:400:kworker.0 00000100:00100000:0.0:1788521804.111475:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521804.111500:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc3ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875400816912768:0@lo:400:kworker.0 00000100:00100000:0.0:1788521804.111522:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521804.111538:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788521804.111543:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc3eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816912640:0@lo:400:kworker.0 00000100:00100000:0.0:1788521804.111585:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521804.111867:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816912256 00000100:00100000:2.0:1788521804.111872:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816912256 00000100:00100000:2.0:1788521804.111911:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788521804.111919:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3307:x1875400816912256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521804.112014:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3307:x1875400816912256:12345-0@lo:400:kworker.0 Request processed in 95us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521804.112021:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788521804.112054:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816912640 00000100:00100000:2.0:1788521804.112058:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816912640 00000100:00100000:2.0:1788521804.112087:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788521804.112093:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816912640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521804.112120:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816912640:12345-0@lo:400:kworker.0 Request processed in 27us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521804.112126:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1788521804.112158:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521804.112167:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816912768 00000100:00100000:2.0:1788521804.112170:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816912768 00000100:00100000:2.0:1788521804.112194:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788521804.112200:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875400816912768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521804.112228:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875400816912768:12345-0@lo:400:kworker.0 Request processed in 28us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521804.112240:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:2.0:1788521804.112257:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521804.114741:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816912256:0@lo:400:kworker.0 00000100:00100000:1.0:1788521804.114990:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc3ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875400816912768:0@lo:400:kworker.0 00000100:00100000:1.0:1788521804.115037:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc3eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816912640:0@lo:400:kworker.0 00000100:00100000:1.0:1788521804.624809:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788521804.625835:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc441500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816913024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521804.625933:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521804.626375:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816913024 00000100:00100000:3.0:1788521804.626386:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816913024 00000100:00100000:3.0:1788521804.626456:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788521804.626468:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc6fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816913024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788521804.626515:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521804.626591:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc6fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816913024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521804.626600:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1788521804.626722:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996fbc441500 x1875400816913024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521820 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521804.626745:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc441500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816913024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521804.793607:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521804.793672:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799052544 00000100:00100000:1.0:1788521804.793686:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799052544 00000100:00100000:1.0:1788521804.793767:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:1.0:1788521804.793782:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+8:10262:x1875400799052544:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1788521804.793807:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521804.793846:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927bf03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00993 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.793934:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927bf0a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.793952:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927bf0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.794113:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927bf0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.794133:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927bf11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.794166:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927bf11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.794175:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927bf11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.794575:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927bf0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.794586:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927bf0a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.794593:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927bf0a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.794600:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521804.794606:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927bf0a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.794615:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927bf0a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.794629:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996f8687ec00) 00010000:00010000:1.0:1788521804.794690:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521804.794698:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927bf0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.794713:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927bf0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.794729:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927bf11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.794735:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927bf11 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.794742:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927bf11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.794747:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d4e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521804.794750:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927bf11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.794756:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927bf11 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.794764:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff996fa0d5c200) 00010000:00010000:1.0:1788521804.794767:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521804.794769:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927bf11 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.794775:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927bf11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.794874:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927bf03 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00993 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.794899:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996f8687ec00) 00010000:00010000:1.0:1788521804.794902:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521804.794907:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927bf03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00993 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.794919:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d5400, rc 0) 00000100:00100000:1.0:1788521804.795399:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+8:10262:x1875400799052544:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 1617us (1801us total) trans 0 rc 301/301 00000100:00100000:1.0:1788521804.795411:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:3.0:1788521804.800840:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521804.800923:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799052800 00000100:00100000:2.0:1788521804.800936:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799052800 00000100:00100000:2.0:1788521804.801011:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 37 00000100:00100000:2.0:1788521804.801024:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+8:10262:x1875400799052800:12345-192.168.206.48@tcp:36:lfs.0 00010000:00010000:2.0:1788521804.801098:0:10083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521804.801131:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927bebd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0097e expref: 8 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.801203:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996f8687ec00) 00010000:00010000:2.0:1788521804.801219:0:10083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521804.801494:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927bf18 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.801510:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927bf18 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.801522:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927bf18 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.801536:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927bf1f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.801542:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927bf1f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.801561:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927bf1f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521804.802648:0:10083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788521804.802666:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927bf18 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.802676:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927bf18 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.802685:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927bf18 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.802691:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490b000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521804.802696:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927bf18 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.802706:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927bf18 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.802723:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19efd00) 00010000:00010000:2.0:1788521804.802728:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521804.802733:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927bf18 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.802740:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927bf18 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788521804.802760:0:10083:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ebff09b4 reply state 000000002034807f transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927bf1f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521804.802771:0:10083:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788521804.803189:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+9:10262:x1875400799052800:12345-192.168.206.48@tcp:36:lfs.0 Request processed in 2152us (2344us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788521804.803210:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 37 00010000:00010000:2.0:1788521804.805387:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927bf1f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.805409:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927bf1f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.805419:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927bf1f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.805425:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490b200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521804.805431:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927bf1f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.805440:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927bf1f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.805458:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff996fb19ef100) 00010000:00010000:2.0:1788521804.805462:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521804.805468:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927bf1f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.805474:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927bf1f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521804.900114:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521804.900898:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799052928 00000100:00100000:2.0:1788521804.900911:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799052928 00000100:00100000:2.0:1788521804.900990:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 38 00000100:00100000:2.0:1788521804.901003:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+8:10270:x1875400799052928:12345-192.168.206.48@tcp:101:lctl.0 00010000:00010000:2.0:1788521804.901630:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521804.901682:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927bf26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd0099a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.901846:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927bf2d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.901864:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927bf2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.901879:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927bf2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521804.903992:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788521804.904004:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521804.904270:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927bf2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.904321:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927bf26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0099a expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.904348:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927bf2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0099a expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.904358:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:2.0:1788521804.904362:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788521804.904366:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490b000, rc 0) 00000100:00100000:2.0:1788521804.904464:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+9:10270:x1875400799052928:12345-192.168.206.48@tcp:101:lctl.0 Request processed in 3463us (4359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521804.904476:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 38 00010000:00010000:3.0:1788521804.943391:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521804.957336:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521804.958089:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799053056 00000100:00100000:2.0:1788521804.958122:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799053056 00000100:00100000:2.0:1788521804.958322:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 39 00000100:00100000:2.0:1788521804.958336:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+9:10276:x1875400799053056:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:2.0:1788521804.958364:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521804.958392:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927bf34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd009a1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.958475:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927bf3b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.958493:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927bf3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.958508:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927bf3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.958526:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bf42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.958534:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bf42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.958541:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bf42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.958676:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a800/0x1b7b50db5927bf49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.958685:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a800/0x1b7b50db5927bf49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.958692:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a800/0x1b7b50db5927bf49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521804.958736:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788521804.958741:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521804.958789:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a800/0x1b7b50db5927bf49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.958803:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927bf3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.958811:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927bf3b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.958818:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927bf3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.958824:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490a400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521804.958829:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927bf3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.958837:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927bf3b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.958851:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:2.0:1788521804.958854:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521804.958860:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927bf3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.958869:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927bf3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.958884:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bf42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.958902:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bf42 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.958908:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bf42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.958913:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490ae00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521804.958916:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bf42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.958923:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bf42 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.958931:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff996fb19efd00) 00010000:00010000:2.0:1788521804.958934:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521804.958936:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bf42 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.958942:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927bf42 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.958982:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927bf34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009a1 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.958998:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a800/0x1b7b50db5927bf49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009a1 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.959079:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:2.0:1788521804.959083:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788521804.959093:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490a800, rc 0) 00000100:00100000:2.0:1788521804.959236:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+10:10276:x1875400799053056:12345-192.168.206.48@tcp:101:bash.0 Request processed in 903us (1916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521804.959245:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 39 00000100:00100000:3.0:1788521804.963942:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521804.964313:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799053312 00000100:00100000:1.0:1788521804.964327:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799053312 00000100:00100000:1.0:1788521804.964415:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 40 00000100:00100000:1.0:1788521804.964426:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+10:10276:x1875400799053312:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:1.0:1788521804.964452:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521804.964479:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927bf50 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd009a8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.964689:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927bf57 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.964709:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927bf57 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.964723:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927bf57 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.966259:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927bf5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.966538:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927bf5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.966563:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927bf5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788521804.967737:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788521804.969376:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927bf65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.969396:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927bf65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.969407:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927bf65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.969444:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927bf57 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.969452:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927bf57 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.969459:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927bf57 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.969466:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d4e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521804.969471:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927bf57 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.969479:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927bf57 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.969507:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:1.0:1788521804.969510:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521804.969515:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927bf57 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.969521:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927bf57 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788521804.969619:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009b07178 reply state 00000000b4d35f2b transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927bf5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521804.969627:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788521804.969663:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927bf50 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009a8 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.969680:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927bf65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009a8 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521804.969687:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996fa0d5c600) 00010000:00010000:1.0:1788521804.969689:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521804.969692:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d4000, rc 0) 00000100:00100000:1.0:1788521804.969828:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+13:10276:x1875400799053312:12345-192.168.206.48@tcp:101:bash.0 Request processed in 5403us (5902us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788521804.969837:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 40 00010000:00010000:0.0:1788521804.972102:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927bf5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521804.972118:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927bf5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521804.972126:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927bf5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521804.972131:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521804.972136:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927bf5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521804.972187:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927bf5e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521804.972206:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996fa0d5c200) 00010000:00010000:0.0:1788521804.972209:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521804.972215:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927bf5e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521804.972223:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927bf5e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521804.977031:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521804.977201:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799053440 00000100:00100000:2.0:1788521804.977217:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799053440 00000100:00100000:2.0:1788521804.977275:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:2.0:1788521804.977287:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc443800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1875400799053440:12345-192.168.206.48@tcp:8:bash.0 00010000:00080000:2.0:1788521804.977328:0:6687:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4bd13e8f-aac9-42ad-8625-a542705d6920@192.168.206.48@tcp t0 exp 0000000000000000 cur 304 last 0 00000020:00000080:2.0:1788521804.977370:0:6687:0:(genops.c:1385:class_connect()) connect: client 4bd13e8f-aac9-42ad-8625-a542705d6920, cookie 0x1b7b50db5927bf73 00002000:00100000:2.0:1788521804.977386:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4bd13e8f-aac9-42ad-8625-a542705d6920/ffff996f9ec07800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788521804.977400:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788521804.977732:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788521804.977771:0:6687:0:(import.c:65:import_set_state_nolock()) ffff996f9ec06800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788521804.977860:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc443800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2360:x1875400799053440:12345-192.168.206.48@tcp:8:bash.0 Request processed in 572us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521804.977869:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:3.0:1788521804.990691:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521804.990783:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799053568 00000100:00100000:2.0:1788521804.990795:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799053568 00000100:00080000:0.0:1788521804.990961:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521804.991113:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:2.0:1788521804.991128:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+6:0:x1875400799053568:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:2.0:1788521804.991196:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521804.991226:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c4bce6b/0x1b7b50db5927bf7a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd009af expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788521804.991269:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788521804.991310:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=304s v=(0 0) 00010000:00010000:2.0:1788521804.991315:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521804.991328:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c4bce6b/0x1b7b50db5927bf7a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009af expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.991353:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c4bce6b/0x1b7b50db5927bf7a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009af expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521804.991371:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490b200, rc 0) 00000100:00100000:2.0:1788521804.991454:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+7:0:x1875400799053568:12345-192.168.206.48@tcp:101:bash.0 Request processed in 330us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521804.991462:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:3.0:1788521804.994886:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521804.995258:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799053696 00000100:00100000:0.0:1788521804.995271:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799053696 00000100:00100000:0.0:1788521804.995418:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:0.0:1788521804.995431:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+7:10276:x1875400799053696:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:0.0:1788521804.995471:0:11097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521804.995512:0:11097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5b1fb20/0x1b7b50db5927bf81 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd009b6 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521804.995560:0:11097:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c4bce6b/0x1b7b50db5927bf7a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009af expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521804.995571:0:11097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521804.995584:0:11097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521804.995591:0:11097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5b1fb20/0x1b7b50db5927bf81 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009b6 expref: 8 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521804.995636:0:11097:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c4bce6b/0x1b7b50db5927bf7a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009af expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521804.995660:0:11097:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c4bce6b/0x1b7b50db5927bf7a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009af expref: 8 pid: 6690 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521804.995687:0:11097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f41c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11097:1875400816913152:192.168.206.48@tcp:104: 00000100:00100000:0.0:1788521804.995799:0:11097:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fad7b3540 going to sleep for 11 seconds 00000100:00100000:0.0:1788521805.002060:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521805.002312:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799053824 00000100:00100000:1.0:1788521805.002324:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799053824 00010000:00010000:1.0:1788521805.002376:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c4bce6b/0x1b7b50db5927bf7a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009af expref: 9 pid: 6690 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521805.002503:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 35 00000100:00100000:1.0:1788521805.002518:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+9:2364:x1875400799053824:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521805.002569:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521805.002601:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c4bce6b/0x1b7b50db5927bf7a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009af expref: 9 pid: 6690 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521805.002625:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c4bce6b/0x1b7b50db5927bf7a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009af expref: 9 pid: 6690 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521805.002655:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c4bce6b/0x1b7b50db5927bf7a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009af expref: 9 pid: 6690 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521805.002678:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521805.002682:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521805.002691:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5b1fb20/0x1b7b50db5927bf81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009b6 expref: 8 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521805.002703:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5b1fb20/0x1b7b50db5927bf81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009b6 expref: 8 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521805.002711:0:11097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f41c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11097:1875400816913152:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788521805.002743:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e5b1fb20/0x1b7b50db5927bf81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009b6 expref: 8 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.002758:0:11097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e5b1fb20/0x1b7b50db5927bf81 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009b6 expref: 8 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.002774:0:11097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fc217ce00, rc 0) 00000100:00100000:1.0:1788521805.002864:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc6fe680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5819:1875400816913280:192.168.206.48@tcp:105: 00000100:00100000:1.0:1788521805.002938:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cb600 going to sleep for 11 seconds 00000100:00100000:2.0:1788521805.004303:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+8:10276:x1875400799053696:12345-192.168.206.48@tcp:101:bash.0 Request processed in 7418us (7974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521805.004316:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:3.0:1788521805.008571:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc6fe680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5819:1875400816913280:192.168.206.48@tcp:105: 00010000:00010000:3.0:1788521805.008680:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521805.008755:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2364:x1875400799053824:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 6239us (6708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521805.008769:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 35 00000100:00100000:3.0:1788521805.014294:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521805.014404:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799054080 00000100:00100000:1.0:1788521805.014417:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799054080 00000100:00100000:1.0:1788521805.014512:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:1.0:1788521805.014526:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+12:10276:x1875400799054080:12345-192.168.206.48@tcp:35:bash.0 00000100:00100000:1.0:1788521805.015018:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+13:10276:x1875400799054080:12345-192.168.206.48@tcp:35:bash.0 Request processed in 494us (737us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788521805.015028:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00080000:0.0:1788521805.016436:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521805.110497:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521805.111062:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799054336 00000100:00100000:2.0:1788521805.111246:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799054336 00000100:00100000:2.0:1788521805.111460:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 41 00000100:00100000:2.0:1788521805.111474:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+13:10286:x1875400799054336:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521805.111515:0:10083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521805.112197:0:10083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927bf88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd009bd expref: -99 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521805.112319:0:10083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788521805.112482:0:10083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927bf88 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009bd expref: 15 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.112499:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:2.0:1788521805.112503:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521805.112510:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927bf88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009bd expref: 15 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.112527:0:10083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490a400, rc 0) 00000100:00100000:2.0:1788521805.112629:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+14:10286:x1875400799054336:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 1158us (2145us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1788521805.112637:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 41 00000100:00100000:2.0:1788521805.116986:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521805.117106:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799054592 00000100:00100000:1.0:1788521805.117253:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799054592 00000100:00100000:1.0:1788521805.117320:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:1.0:1788521805.117332:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+14:10286:x1875400799054592:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:1.0:1788521805.117739:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+15:10286:x1875400799054592:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 408us (766us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788521805.117747:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:3.0:1788521805.198327:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521805.198635:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799054720 00000100:00100000:2.0:1788521805.198648:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799054720 00000100:00100000:2.0:1788521805.198731:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 42 00000100:00100000:2.0:1788521805.198743:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+15:10292:x1875400799054720:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521805.198774:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521805.198800:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927bf96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd009c4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.198888:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927bf9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.198927:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927bf9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.198943:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927bf9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521805.198988:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788521805.198992:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521805.199014:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927bf9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.199045:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927bf96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009c4 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.199067:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927bf9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009c4 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.199076:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:2.0:1788521805.199079:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788521805.199083:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490b600, rc 0) 00000100:00100000:2.0:1788521805.199223:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+16:10292:x1875400799054720:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 481us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521805.199231:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 42 00000100:00100000:0.0:1788521805.204346:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521805.204427:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799054976 00000100:00100000:3.0:1788521805.204440:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799054976 00000100:00100000:3.0:1788521805.204531:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 43 00000100:00100000:3.0:1788521805.204543:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+16:10292:x1875400799054976:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521805.204586:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521805.204614:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927bfa4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd009cb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.204769:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927bfab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.204785:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927bfab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.204799:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927bfab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521805.204812:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788521805.204980:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927bfa4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009cb expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.205015:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927bfab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009cb expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.205025:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996fa0d5c600) 00010000:00010000:3.0:1788521805.205029:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521805.205033:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392c800, rc 0) 00000100:00100000:3.0:1788521805.205110:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+18:10292:x1875400799054976:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 570us (779us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788521805.205118:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 43 00000100:00100000:2.0:1788521805.209636:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521805.209695:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521805.209829:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799055360 00000100:00100000:3.0:1788521805.209858:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799055360 00000100:00100000:3.0:1788521805.210020:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 44 00000100:00100000:3.0:1788521805.210035:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+18:10292:x1875400799055360:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521805.210075:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521805.210102:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927bfb9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd009d2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.210272:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927bfc0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.210291:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927bfc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.210306:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927bfc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521805.210322:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788521805.210503:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927bfb9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009d2 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.210523:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927bfc0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009d2 expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.210534:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996fa0d5c600) 00010000:00010000:3.0:1788521805.210537:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788521805.210541:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392de00, rc 0) 00000100:00100000:3.0:1788521805.210633:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+20:10292:x1875400799055360:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 601us (1011us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788521805.210641:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 44 00000100:00100000:0.0:1788521805.210945:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799055104 00000100:00100000:0.0:1788521805.210952:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799055104 00000100:00100000:0.0:1788521805.211002:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:0.0:1788521805.211010:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+20:2361:x1875400799055104:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521805.211022:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521805.211040:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927bfab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009cb expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521805.211053:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996fa0d5c600) 00010000:00010000:0.0:1788521805.211057:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521805.211083:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+19:2361:x1875400799055104:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 74us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521805.211090:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:1.0:1788521805.225482:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521805.225601:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799055488 00000100:00100000:3.0:1788521805.225614:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799055488 00000100:00100000:3.0:1788521805.225689:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:3.0:1788521805.225701:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc6fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2362:x1875400799055488:12345-192.168.206.48@tcp:1:lfs.0 00010000:00010000:3.0:1788521805.225757:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002513b847/0x1b7b50db5927bfce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.225779:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5b1fb20/0x1b7b50db5927bf81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009b6 expref: 7 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.225788:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788521805.225792:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521805.225797:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002513b847/0x1b7b50db5927bfce lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.225837:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e5b1fb20/0x1b7b50db5927bf81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009b6 expref: 7 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.225862:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e5b1fb20/0x1b7b50db5927bf81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009b6 expref: 7 pid: 11097 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521805.225878:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc443b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6689:1875400816913408:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788521805.225989:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90d8fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521805.230790:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc443b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6689:1875400816913408:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788521805.230858:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002513b847/0x1b7b50db5927bfce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521805.231985:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521805.232129:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799055616 00000100:00100000:3.0:1788521805.232294:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799055616 00002000:00100000:3.0:1788521805.232468:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff996fb7f41500 x1875400799055616/t0(0) o4->4bd13e8f-aac9-42ad-8625-a542705d6920@192.168.206.48@tcp:51/0 lens 504/0 e 0 to 0 dl 1788521816 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788521805.232481:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff996fb7f41500 with x1875400799055616 ext(0->12) 00010000:00010000:3.0:1788521805.232491:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e5b1fb20/0x1b7b50db5927bf81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009b6 expref: 8 pid: 11097 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.232514:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e5b1fb20/0x1b7b50db5927bf81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009b6 expref: 8 pid: 11097 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788521805.232522:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff996fb7f41500 00000100:00100000:3.0:1788521805.232562:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:3.0:1788521805.232573:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+8:2364:x1875400799055616:12345-192.168.206.48@tcp:4:lfs.0 00000001:00100000:0.0:1788521805.266599:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4bd13e8f-aac9-42ad-8625-a542705d6920 00000100:00100000:2.0:1788521805.268140:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+9:2364:x1875400799055616:12345-192.168.206.48@tcp:4:lfs.0 Request processed in 35562us (36156us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788521805.268187:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 0 00002000:00100000:2.0:1788521805.268611:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff996fb7f41500 x1875400799055616/t4294967299(0) o4->4bd13e8f-aac9-42ad-8625-a542705d6920@192.168.206.48@tcp:51/0 lens 504/448 e 0 to 0 dl 1788521816 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788521805.268624:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff996fb7f41500 with x1875400799055616 ext(0->12) 00010000:00010000:2.0:1788521805.268635:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e5b1fb20/0x1b7b50db5927bf81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009b6 expref: 9 pid: 11097 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.268658:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e5b1fb20/0x1b7b50db5927bf81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009b6 expref: 9 pid: 11097 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788521805.268667:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff996fb7f41500 00000100:00100000:2.0:1788521805.272083:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521805.272194:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799055744 00000100:00100000:3.0:1788521805.272209:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799055744 00010000:00010000:3.0:1788521805.272262:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e5b1fb20/0x1b7b50db5927bf81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009b6 expref: 9 pid: 11097 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521805.272301:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:3.0:1788521805.272313:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+9:2363:x1875400799055744:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521805.272331:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788521805.272354:0:7632:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788521805.272357:0:7632:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788521805 00002000:00010000:3.0:1788521805.272375:0:7632:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788521805 00002000:00010000:3.0:1788521805.272377:0:7632:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788521805 00010000:00010000:3.0:1788521805.272384:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e5b1fb20/0x1b7b50db5927bf81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009b6 expref: 9 pid: 11097 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.272409:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e5b1fb20/0x1b7b50db5927bf81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009b6 expref: 9 pid: 11097 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.272438:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5b1fb20/0x1b7b50db5927bf81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009b6 expref: 9 pid: 11097 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.272458:0:7632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521805.272463:0:7632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521805.272469:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002513b847/0x1b7b50db5927bfce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.272480:0:7632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002513b847/0x1b7b50db5927bfce lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.272517:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521805.272565:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002513b847/0x1b7b50db5927bfce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.272582:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002513b847/0x1b7b50db5927bfce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.272617:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002513b847/0x1b7b50db5927bfce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.272626:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002513b847/0x1b7b50db5927bfce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.272634:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002513b847/0x1b7b50db5927bfce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.272660:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392d400 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:2.0:1788521805.272664:0:6689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002513b847/0x1b7b50db5927bfce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.272673:0:6689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002513b847/0x1b7b50db5927bfce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.272691:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002513b847/0x1b7b50db5927bfce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.272699:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002513b847/0x1b7b50db5927bfce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521805.272990:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc6fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+8:2362:x1875400799055488:12345-192.168.206.48@tcp:1:lfs.0 Request processed in 47289us (47520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521805.273000:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:3.0:1788521805.273695:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2363:x1875400799055744:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 1375us (1613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521805.273708:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:2.0:1788521805.275424:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521805.275512:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799056000 00000100:00100000:1.0:1788521805.275524:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799056000 00000100:00100000:1.0:1788521805.275722:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:1.0:1788521805.275733:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+19:10292:x1875400799056000:12345-192.168.206.48@tcp:35:lfs.0 00000004:00010000:1.0:1788521805.275829:0:5837:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927bfc0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009d2 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788521805.276252:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1788521805.276311:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1788521805.277418:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1788521805.277513:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927bfd5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521805.277534:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927bf65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009a8 expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521805.277555:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927bfd5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521805.277825:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927bf65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009a8 expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521805.277921:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927bf65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009a8 expref: 23 pid: 5835 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521805.277939:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc6fea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1875400816913536:192.168.206.48@tcp:104: 00000100:00100000:1.0:1788521805.278121:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521805.282695:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc6fea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1875400816913536:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788521805.282741:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927bfd5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521805.286290:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521805.286382:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799056128 00000100:00100000:3.0:1788521805.286396:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799056128 00010000:00010000:3.0:1788521805.286453:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927bf65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009a8 expref: 24 pid: 5835 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521805.286516:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 37 00000100:00100000:3.0:1788521805.286528:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+24:2364:x1875400799056128:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521805.286564:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521805.286581:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927bf65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009a8 expref: 24 pid: 5835 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.286604:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927bf65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009a8 expref: 24 pid: 5835 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.286631:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927bf65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009a8 expref: 24 pid: 5835 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.286650:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996fa0d5c600) 00010000:00010000:3.0:1788521805.286657:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927bfd5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.286667:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927bfd5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.286675:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927bfd5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.286712:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521805.286789:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+23:2364:x1875400799056128:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 263us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521805.286797:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 37 00010000:00010000:2.0:1788521805.286903:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927bfd5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.286913:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927bfd5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788521805.287086:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788521805.287385:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1788521805.287539:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc3ed500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1875400816913664:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788521805.287679:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521805.287704:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86745540 going to sleep for 11 seconds 00000100:00100000:1.0:1788521805.288736:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816913664 00000100:00100000:1.0:1788521805.288750:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816913664 00000100:00100000:1.0:1788521805.288818:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788521805.288829:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1875400816913664:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788521805.288969:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1875400816913664:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 142us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521805.288977:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788521805.289130:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc3ed500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1875400816913664:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788521805.290350:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1788521805.290463:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f40700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1875400816913792:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788521805.290533:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521805.290586:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f84ef8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521805.291083:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816913792 00000100:00100000:1.0:1788521805.291093:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816913792 00000100:00100000:1.0:1788521805.291157:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788521805.291168:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1875400816913792:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788521805.291171:0:5839:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788521805.291180:0:5839:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1788521805.291433:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5837:x1875400816913792:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 266us (899us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788521805.291441:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788521805.291685:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f40700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1875400816913792:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788521805.291759:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1788521805.291809:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927bfd5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.291822:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927bfd5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.291831:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927bfd5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.291838:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d4a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521805.291843:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927bfd5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.291852:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927bfd5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.291871:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996fa0d5c600) 00010000:00010000:2.0:1788521805.291874:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788521805.291880:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927bfd5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.291900:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927bfd5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788521805.292827:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788521805.293805:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788521805.293822:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 305278679074ns, next at 306278675764ns, rc = 0 00000001:00080000:2.0:1788521805.293836:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1788521805.293905:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996fa0d5c600) 00010000:00010000:2.0:1788521805.293910:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788521805.293922:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927bfc0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009d2 expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521805.294752:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+26:10292:x1875400799056000:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 19012us (19329us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788521805.294771:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 8 00000020:00080000:2.0:1788521805.294778:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788521805.297491:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521805.297564:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799056256 00000100:00100000:3.0:1788521805.297682:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799056256 00000100:00100000:3.0:1788521805.297764:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 45 00000100:00100000:3.0:1788521805.297776:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+26:10292:x1875400799056256:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521805.297822:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521805.297851:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927bfdc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd009d9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.297931:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927bfdc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009d9 expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.297947:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927bfdc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009d9 expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.297965:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687e000) 00010000:00010000:3.0:1788521805.297968:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788521805.297970:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392da00, rc 0) 00000100:00100000:3.0:1788521805.298130:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+27:10292:x1875400799056256:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 356us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521805.298138:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 45 00000100:00100000:1.0:1788521805.301421:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521805.301595:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799056512 00000100:00100000:3.0:1788521805.301608:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799056512 00000100:00100000:3.0:1788521805.301679:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:3.0:1788521805.301691:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f97fd2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+27:10292:x1875400799056512:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:3.0:1788521805.302197:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f97fd2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+28:10292:x1875400799056512:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 506us (789us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1788521805.302217:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:1.0:1788521805.362564:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521805.363781:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799056768 00000100:00100000:2.0:1788521805.363796:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799056768 00000100:00100000:2.0:1788521805.363883:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00100000:2.0:1788521805.363894:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc6ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+28:10302:x1875400799056768:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521805.363990:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521805.364016:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927bfe3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd009e0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521805.364168:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788521805.364339:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927bfe3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009e0 expref: 30 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.364376:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:2.0:1788521805.364379:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521805.364386:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927bfe3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009e0 expref: 30 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.364404:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490aa00, rc 0) 00000100:00100000:2.0:1788521805.364496:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc6ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+29:10302:x1875400799056768:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 603us (1957us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1788521805.364504:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00100000:0.0:1788521805.369037:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521805.369532:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799056896 00000100:00100000:2.0:1788521805.369553:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799056896 00000100:00100000:2.0:1788521805.369623:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 47 00000100:00100000:2.0:1788521805.369635:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+29:10302:x1875400799056896:12345-192.168.206.48@tcp:34:lfs.0 00010000:00010000:2.0:1788521805.369732:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927bff1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.369754:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927bff1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.369768:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927bff1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.369785:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927bff8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.369792:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927bff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.369822:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927bff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.369945:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927bfff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.369955:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927bfff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.369963:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927bfff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788521805.370030:0:10083:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927bfff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.370046:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927bff1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.370054:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927bff1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.370062:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927bff1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.370069:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490aa00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521805.370075:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927bff1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.370084:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927bff1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.370099:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:2.0:1788521805.370108:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521805.370115:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927bff1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.370122:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927bff1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.370136:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927bff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.370178:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927bff8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.370185:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927bff8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.370191:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490a200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521805.370194:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927bff8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.370201:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927bff8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.370210:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996fb19efd00) 00010000:00010000:2.0:1788521805.370213:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521805.370216:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927bff8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.370222:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927bff8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.370239:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927bfff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.370252:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927bfff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.370259:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927bfff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.370265:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490ac00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521805.370269:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927bfff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.370275:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927bfff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.370284:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687e000) 00010000:00010000:2.0:1788521805.370286:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521805.370290:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927bfff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.370297:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927bfff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521805.370397:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+29:10302:x1875400799056896:12345-192.168.206.48@tcp:34:lfs.0 Request processed in 762us (1370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521805.370406:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 47 00000100:00100000:1.0:1788521805.375484:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521805.375595:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799057152 00000100:00100000:3.0:1788521805.375625:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799057152 00000100:00100000:3.0:1788521805.375699:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:3.0:1788521805.375712:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc6fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+29:10302:x1875400799057152:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:3.0:1788521805.376294:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc6fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+30:10302:x1875400799057152:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 582us (816us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1788521805.376304:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:1.0:1788521805.432815:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521805.433037:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799057408 00000100:00100000:3.0:1788521805.433051:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799057408 00000100:00100000:3.0:1788521805.433132:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 48 00000100:00100000:3.0:1788521805.433164:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc6fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+30:10305:x1875400799057408:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521805.433189:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521805.433210:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c006 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd009e7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.433283:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c00d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.433297:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c00d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.433309:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c00d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.433325:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c014 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.433349:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.433357:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.433671:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c01b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.433682:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c01b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.433689:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c01b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521805.433700:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788521805.433788:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c00d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.433797:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c00d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.433803:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c00d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.433810:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392de00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521805.433814:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c00d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.433822:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c00d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.433846:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:3.0:1788521805.433849:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521805.433854:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c00d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.433860:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c00d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.433874:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.433880:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c014 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.433886:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.433892:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392d400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521805.433894:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.433901:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c014 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.433909:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996f8687eb00) 00010000:00010000:3.0:1788521805.433911:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521805.433914:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c014 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.433920:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c014 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.433979:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c006 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009e7 expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.434342:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c01b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009e7 expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.434350:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687e000) 00010000:00010000:3.0:1788521805.434352:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521805.434355:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392c800, rc 0) 00000100:00100000:3.0:1788521805.434432:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc6fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+32:10305:x1875400799057408:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 1279us (1620us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1788521805.434441:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 48 00000100:00100000:0.0:1788521805.438873:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521805.438965:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799057536 00000100:00100000:2.0:1788521805.438974:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799057536 00000100:00100000:2.0:1788521805.439028:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 49 00000100:00100000:2.0:1788521805.439038:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+32:10305:x1875400799057536:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:2.0:1788521805.439101:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c029 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.439128:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.439785:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.439820:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.439827:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c029 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.439834:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c029 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.439840:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490ac00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521805.439845:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c029 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.439853:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c029 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.439866:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687e000) 00010000:00010000:2.0:1788521805.439870:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521805.439874:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c029 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.439880:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c029 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521805.439966:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+32:10305:x1875400799057536:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 927us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521805.439984:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 49 00000100:00100000:1.0:1788521805.448062:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521805.448137:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799057792 00000100:00100000:2.0:1788521805.448185:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799057792 00000100:00100000:2.0:1788521805.448239:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:2.0:1788521805.448250:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f8574b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+32:10305:x1875400799057792:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:2.0:1788521805.448462:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f8574b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+33:10305:x1875400799057792:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 213us (407us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788521805.448469:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:1.0:1788521805.702214:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521805.702369:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799058048 00000100:00100000:2.0:1788521805.702379:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799058048 00000100:00100000:2.0:1788521805.702438:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 50 00000100:00100000:2.0:1788521805.702449:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+33:10336:x1875400799058048:12345-192.168.206.48@tcp:101:cat.0 00010000:00010000:2.0:1788521805.702470:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521805.702489:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c030 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd009ee expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.702592:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c037 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.702607:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.702618:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521805.702960:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788521805.703226:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c030 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009ee expref: 36 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.703259:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c037 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009ee expref: 35 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.703268:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687e000) 00010000:00010000:2.0:1788521805.703271:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521805.703279:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490a200, rc 0) 00000100:00100000:2.0:1788521805.703433:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+35:10336:x1875400799058048:12345-192.168.206.48@tcp:101:cat.0 Request processed in 984us (1225us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788521805.703441:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 50 00000100:00100000:2.0:1788521805.706351:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521805.706438:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799058176 00000100:00100000:1.0:1788521805.706448:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799058176 00000100:00100000:1.0:1788521805.706559:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:1.0:1788521805.706570:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f856e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+35:2361:x1875400799058176:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521805.706585:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521805.706607:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c037 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009ee expref: 35 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521805.706639:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687e000) 00010000:00010000:1.0:1788521805.706644:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521805.706699:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f856e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+34:2361:x1875400799058176:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 131us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521805.706706:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:1.0:1788521805.714659:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521805.714782:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799058432 00000100:00100000:2.0:1788521805.714797:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799058432 00000100:00100000:2.0:1788521805.714881:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:2.0:1788521805.714896:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f8574b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+34:10336:x1875400799058432:12345-192.168.206.48@tcp:35:cat.0 00000100:00100000:2.0:1788521805.715253:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f8574b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+35:10336:x1875400799058432:12345-192.168.206.48@tcp:35:cat.0 Request processed in 361us (606us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788521805.715261:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:3.0:1788521805.763966:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521805.764107:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799058688 00000100:00100000:2.0:1788521805.764120:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799058688 00000100:00100000:2.0:1788521805.764235:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 51 00000100:00100000:2.0:1788521805.764249:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+35:10342:x1875400799058688:12345-192.168.206.48@tcp:101:dd.0 00010000:00010000:2.0:1788521805.764283:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521805.764288:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788521805.764322:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927bf9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009c4 expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.764434:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:2.0:1788521805.764440:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521805.764458:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c045 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd009f5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.764593:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c04c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.764610:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c01b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009e7 expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.764620:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c04c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.764659:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c01b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009e7 expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.764684:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c01b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009e7 expref: 35 pid: 5834 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521805.764700:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc3ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1875400816913920:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788521805.764907:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86745480 going to sleep for 11 seconds 00000100:00100000:0.0:1788521805.772618:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521805.773178:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799058816 00000100:00100000:3.0:1788521805.773191:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799058816 00010000:00010000:3.0:1788521805.773246:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c01b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009e7 expref: 36 pid: 5834 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521805.773298:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 38 00000100:00100000:3.0:1788521805.773310:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+36:2364:x1875400799058816:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521805.773329:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521805.773338:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c01b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009e7 expref: 36 pid: 5834 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.773363:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c01b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009e7 expref: 36 pid: 5834 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.773416:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687e000) 00010000:00010000:3.0:1788521805.773422:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c04c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.773434:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c04c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.773443:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c04c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521805.773468:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521805.773671:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+36:2364:x1875400799058816:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 352us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521805.773679:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 38 00010000:00010000:2.0:1788521805.773925:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c01b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009e7 expref: 35 pid: 5834 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521805.773947:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc3ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1875400816913920:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788521805.773989:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c04c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.774012:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c04c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.774019:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c04c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521805.774042:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788521805.774341:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c045 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009f5 expref: 36 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.774360:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c04c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009f5 expref: 35 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.774368:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687e000) 00010000:00010000:2.0:1788521805.774371:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788521805.774373:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490aa00, rc 0) 00000100:00100000:2.0:1788521805.774417:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+35:10342:x1875400799058688:12345-192.168.206.48@tcp:101:dd.0 Request processed in 10173us (10466us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788521805.774425:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 51 00000100:00100000:0.0:1788521805.779006:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521805.779168:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799059072 00000100:00100000:2.0:1788521805.779181:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799059072 00000100:00100000:2.0:1788521805.779303:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 52 00000100:00100000:2.0:1788521805.779316:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+35:10342:x1875400799059072:12345-192.168.206.48@tcp:36:dd.0 00010000:00010000:2.0:1788521805.779702:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c05a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.779729:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c05a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.779742:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c05a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788521805.779884:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1788521805.779916:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f15a41f reply state 00000000d7cc357c transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c05a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521805.779925:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788521805.780052:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+38:10342:x1875400799059072:12345-192.168.206.48@tcp:36:dd.0 Request processed in 737us (1068us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788521805.780060:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 52 00000020:00080000:2.0:1788521805.780066:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788521805.782010:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c05a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.782029:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c05a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.782042:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c05a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.782050:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490b600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521805.782056:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c05a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.782066:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c05a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.782111:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687e000) 00010000:00010000:2.0:1788521805.782115:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521805.782122:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c05a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.782129:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c05a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521805.967554:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521806.019267:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521806.019400:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799059200 00000100:00100000:2.0:1788521806.019415:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799059200 00000100:00100000:2.0:1788521806.019539:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 53 00000100:00100000:2.0:1788521806.019564:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+37:10356:x1875400799059200:12345-192.168.206.48@tcp:101:stat.0 00010000:00010000:2.0:1788521806.019595:0:10083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521806.019623:0:10083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c061 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd009fc expref: -99 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.019708:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c068 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.019728:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c068 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.019745:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c068 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.019764:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c06f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.019781:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c06f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.019807:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c06f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.019939:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c076 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.019963:0:10083:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c04c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009f5 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.019973:0:10083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c076 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.020016:0:10083:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c04c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009f5 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.020042:0:10083:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c04c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009f5 expref: 38 pid: 5833 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521806.020058:0:10083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc3ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10083:1875400816914048:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788521806.020216:0:10083:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86745180 going to sleep for 11 seconds 00000100:00100000:2.0:1788521806.023523:0:10083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc3ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10083:1875400816914048:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788521806.023575:0:10083:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c076 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521806.023589:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521806.024398:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799059456 00000100:00100000:1.0:1788521806.024411:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799059456 00000100:00100000:1.0:1788521806.024536:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:1.0:1788521806.024560:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+39:5598:x1875400799059456:12345-192.168.206.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788521806.025563:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+40:5598:x1875400799059456:12345-192.168.206.48@tcp:35:ldlm_bl.0 Request processed in 1000us (1968us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1788521806.025585:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:1.0:1788521806.027978:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521806.028189:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799059584 00000100:00100000:0.0:1788521806.028202:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799059584 00010000:00010000:0.0:1788521806.028251:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c04c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009f5 expref: 40 pid: 5833 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521806.028369:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 39 00000100:00100000:0.0:1788521806.028381:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85748700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+40:2364:x1875400799059584:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521806.028400:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521806.028419:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c04c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009f5 expref: 40 pid: 5833 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.028444:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c04c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009f5 expref: 40 pid: 5833 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.028471:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c04c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009f5 expref: 40 pid: 5833 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.028490:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687e000) 00010000:00010000:0.0:1788521806.028495:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c076 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.028506:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.028515:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c076 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.028567:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521806.028642:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85748700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+39:2364:x1875400799059584:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 263us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521806.028650:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 39 00010000:00010000:3.0:1788521806.029131:0:10083:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.029168:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521806.029227:0:10083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788521806.029233:0:10083:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788521806.029284:0:10083:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.029300:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.029629:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c068 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.029652:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c068 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.029659:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c068 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.029666:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490ac00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521806.029671:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c068 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.029680:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c068 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.029694:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:3.0:1788521806.029697:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521806.029702:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c068 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.029709:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c068 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.029727:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c06f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.029733:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c06f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.029740:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c06f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.029745:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490a200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521806.029755:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c06f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.029945:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c06f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.030019:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996fb19efd00) 00010000:00010000:3.0:1788521806.030022:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521806.030026:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c06f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.030031:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c06f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.030082:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c061 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009fc expref: 39 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.030099:0:10083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c076 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009fc expref: 38 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.030107:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687e000) 00010000:00010000:3.0:1788521806.030109:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521806.030112:0:10083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490a400, rc 0) 00000100:00100000:3.0:1788521806.032874:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+38:10356:x1875400799059200:12345-192.168.206.48@tcp:101:stat.0 Request processed in 13299us (13608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521806.032889:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 53 00000100:00100000:1.0:1788521806.094880:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521806.094934:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521806.094973:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521806.095112:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799059840 00000100:00100000:2.0:1788521806.095125:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799059840 00000100:00100000:2.0:1788521806.095231:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 65 00000100:00100000:2.0:1788521806.095245:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2362:x1875400799059840:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521806.095272:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799059968 00000100:00100000:3.0:1788521806.095278:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799059968 00000100:00100000:3.0:1788521806.095322:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 118 00000100:00100000:3.0:1788521806.095335:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2362:x1875400799059968:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521806.095389:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2362:x1875400799059968:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 59us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521806.095399:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 118 00000100:00100000:0.0:1788521806.095654:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799059712 00000100:00100000:0.0:1788521806.095668:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799059712 00000100:00100000:2.0:1788521806.095698:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2362:x1875400799059840:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 454us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521806.095707:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 65 00000100:00100000:0.0:1788521806.095714:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 277 00000100:00100000:0.0:1788521806.095827:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+13:2362:x1875400799059712:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521806.095858:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+13:2362:x1875400799059712:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 137us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521806.095865:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 277 00000100:00080000:1.0:1788521806.096017:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788521806.096023:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788521806.105719:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521806.105807:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799060224 00000100:00100000:3.0:1788521806.105821:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799060224 00000100:00100000:3.0:1788521806.106258:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 54 00000100:00100000:3.0:1788521806.106274:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+38:10362:x1875400799060224:12345-192.168.206.48@tcp:36:truncate.0 00010000:00010000:3.0:1788521806.106365:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521806.106402:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c076 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009fc expref: 38 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.106428:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687e000) 00010000:00010000:3.0:1788521806.106434:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788521806.106948:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c07d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.106967:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c07d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.107573:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c07d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788521806.108102:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1788521806.108315:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d98a4fa reply state 0000000084e0cb6b transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c07d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521806.108433:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788521806.108633:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+40:10362:x1875400799060224:12345-192.168.206.48@tcp:36:truncate.0 Request processed in 2358us (2922us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1788521806.109524:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 54 00000020:00080000:3.0:1788521806.109533:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788521806.111776:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c07d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.111798:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c07d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.111807:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c07d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.111814:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392c400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521806.111820:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c07d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.111828:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c07d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.111849:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687e000) 00010000:00010000:0.0:1788521806.111853:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521806.111859:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c07d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.111866:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c07d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521806.158592:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788521806.158623:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816914176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521806.158720:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521806.160529:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816914176 00000100:00100000:2.0:1788521806.160560:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816914176 00000100:00100000:2.0:1788521806.160675:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788521806.160687:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816914176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788521806.160735:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521806.160839:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816914176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (2118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521806.160847:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1788521806.160990:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521806.161007:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816914176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521806.240298:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521806.240662:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799060352 00000100:00100000:3.0:1788521806.240675:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799060352 00000100:00100000:3.0:1788521806.240835:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 55 00000100:00100000:3.0:1788521806.240849:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85dc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+39:10377:x1875400799060352:12345-192.168.206.48@tcp:101:stat.0 00010000:00010000:3.0:1788521806.240889:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521806.240917:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c084 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00a03 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.241044:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c08b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.241063:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c08b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.241078:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c08b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.241428:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c092 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.241437:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.241456:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.241580:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c099 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.241589:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.241597:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521806.241642:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1788521806.241647:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788521806.241672:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.241685:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.241694:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c08b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.241701:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c08b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.241708:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c08b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.241715:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392de00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521806.241720:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c08b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.241735:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c08b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.241747:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:3.0:1788521806.241751:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521806.241756:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c08b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.241776:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c08b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.241793:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.241951:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c092 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.241961:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c092 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.241966:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392c400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521806.242031:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c092 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.242041:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c092 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.242050:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996f8687eb00) 00010000:00010000:3.0:1788521806.242053:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521806.242056:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c092 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.242073:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c092 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.242117:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c084 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a03 expref: 41 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.242133:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c099 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a03 expref: 40 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.242140:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687e000) 00010000:00010000:3.0:1788521806.242184:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521806.242187:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392c800, rc 0) 00000100:00100000:3.0:1788521806.243960:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85dc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+40:10377:x1875400799060352:12345-192.168.206.48@tcp:101:stat.0 Request processed in 3101us (3733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521806.243978:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 55 00000100:00100000:1.0:1788521806.301189:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521806.301283:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799060608 00000100:00100000:2.0:1788521806.301296:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799060608 00000100:00100000:2.0:1788521806.301364:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 56 00000100:00100000:2.0:1788521806.301375:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+40:10387:x1875400799060608:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521806.301401:0:10083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521806.301436:0:10083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c0a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00a0a expref: -99 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521806.301563:0:10083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788521806.302803:0:10083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c0a0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a0a expref: 42 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.303081:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:2.0:1788521806.303085:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521806.303093:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c0a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a0a expref: 42 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.303131:0:10083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490bc00, rc 0) 00000100:00100000:2.0:1788521806.303870:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+41:10387:x1875400799060608:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 2492us (2730us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1788521806.303881:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 56 00000100:00100000:1.0:1788521806.308642:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521806.308986:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799060864 00000100:00100000:3.0:1788521806.309067:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799060864 00000100:00100000:3.0:1788521806.309187:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:3.0:1788521806.309200:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+41:10387:x1875400799060864:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:3.0:1788521806.309549:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+42:10387:x1875400799060864:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 332us (900us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1788521806.309559:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:3.0:1788521806.350824:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521806.350967:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799061120 00000100:00100000:2.0:1788521806.350980:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799061120 00000100:00100000:2.0:1788521806.351090:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 57 00000100:00100000:2.0:1788521806.351103:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+42:10393:x1875400799061120:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:2.0:1788521806.351133:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521806.351207:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c0ae lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00a11 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.351339:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c0b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.351362:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c099 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a03 expref: 43 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.351372:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c0b5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.351416:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c099 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a03 expref: 43 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.351439:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c099 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a03 expref: 43 pid: 5834 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521806.351483:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc3ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875400816914304:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788521806.351611:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86745780 going to sleep for 11 seconds 00000100:00100000:1.0:1788521806.355378:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521806.355938:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc3ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875400816914304:192.168.206.48@tcp:104: 00000100:00100000:0.0:1788521806.356093:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799061248 00000100:00100000:0.0:1788521806.356102:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799061248 00010000:00010000:0.0:1788521806.356185:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c099 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a03 expref: 44 pid: 5834 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.356253:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c0b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521806.356293:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 40 00000100:00100000:0.0:1788521806.356307:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+44:2364:x1875400799061248:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521806.356327:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521806.356335:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c099 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a03 expref: 44 pid: 5834 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.356360:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c099 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a03 expref: 44 pid: 5834 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.356386:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c099 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a03 expref: 44 pid: 5834 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.356405:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687e000) 00010000:00010000:0.0:1788521806.356410:0:7633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c0b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.356421:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c0b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.356429:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c0b5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.356470:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521806.356610:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c0b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.356619:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c0b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521806.356641:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000100:00100000:0.0:1788521806.356713:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+43:2364:x1875400799061248:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 408us (1348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521806.356723:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 40 00010000:00010000:2.0:1788521806.356855:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c0ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a11 expref: 44 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.356880:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c0b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a11 expref: 43 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.356897:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687e000) 00010000:00010000:2.0:1788521806.356900:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788521806.356903:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490ae00, rc 0) 00000100:00100000:2.0:1788521806.356933:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+43:10393:x1875400799061120:12345-192.168.206.48@tcp:101:bash.0 Request processed in 5833us (6122us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788521806.356941:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 57 00000100:00100000:1.0:1788521806.359743:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521806.359859:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799061504 00000100:00100000:3.0:1788521806.359871:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799061504 00000100:00100000:3.0:1788521806.359947:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 58 00000100:00100000:3.0:1788521806.359981:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+43:10393:x1875400799061504:12345-192.168.206.48@tcp:36:bash.0 00010000:00010000:3.0:1788521806.360411:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c0c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.360428:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c0c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.360439:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c0c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788521806.360497:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1788521806.360522:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2768944 reply state 000000001aec8cd5 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c0c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521806.360532:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788521806.360751:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+46:10393:x1875400799061504:12345-192.168.206.48@tcp:36:bash.0 Request processed in 774us (1016us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1788521806.360760:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 58 00000020:00080000:3.0:1788521806.360766:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788521806.363344:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c0c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.363386:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c0c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.363396:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c0c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.363404:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392c400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521806.363410:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c0c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.363420:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c0c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.363442:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687e000) 00010000:00010000:2.0:1788521806.363445:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521806.363450:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c0c3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.363457:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c0c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521806.365070:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521806.365383:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799061632 00000100:00100000:3.0:1788521806.365396:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799061632 00000100:00100000:3.0:1788521806.365764:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 59 00000100:00100000:3.0:1788521806.365778:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+45:10393:x1875400799061632:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:3.0:1788521806.366058:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521806.366086:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c0ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00a18 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.366367:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c0d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.366606:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c0b5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a11 expref: 46 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.366730:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c0d1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.366774:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c0b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a11 expref: 46 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.366873:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c0b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a11 expref: 46 pid: 5835 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521806.366893:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc442d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875400816914432:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788521806.367509:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb49056c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521806.372445:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc442d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875400816914432:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788521806.372489:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c0d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521806.373578:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521806.373766:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799061760 00000100:00100000:3.0:1788521806.373777:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799061760 00010000:00010000:3.0:1788521806.373827:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c0b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a11 expref: 47 pid: 5835 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521806.373875:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 41 00000100:00100000:3.0:1788521806.373886:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+47:2364:x1875400799061760:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521806.373904:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521806.373912:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c0b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a11 expref: 47 pid: 5835 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.373934:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c0b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a11 expref: 47 pid: 5835 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.374186:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c0b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a11 expref: 47 pid: 5835 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.374207:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687e000) 00010000:00010000:3.0:1788521806.374213:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c0d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.374223:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c0d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.374232:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c0d1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.374263:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521806.374338:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+46:2364:x1875400799061760:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 453us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521806.374346:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 41 00010000:00010000:0.0:1788521806.374531:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c0d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.374551:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c0d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521806.374619:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788521806.374625:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788521806.374656:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c0d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.374692:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c0ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a18 expref: 46 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.374709:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c0d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a18 expref: 45 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.374717:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687e000) 00010000:00010000:0.0:1788521806.374721:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788521806.374724:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392de00, rc 0) 00000100:00100000:0.0:1788521806.374752:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+45:10393:x1875400799061632:12345-192.168.206.48@tcp:101:bash.0 Request processed in 8979us (9692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521806.374760:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 59 00000100:00100000:3.0:1788521806.379882:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521806.380732:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799062016 00000100:00100000:2.0:1788521806.380745:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799062016 00000100:00100000:2.0:1788521806.380815:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:2.0:1788521806.380828:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f97fd3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+45:10393:x1875400799062016:12345-192.168.206.48@tcp:35:bash.0 00000100:00100000:2.0:1788521806.381134:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f97fd3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+46:10393:x1875400799062016:12345-192.168.206.48@tcp:35:bash.0 Request processed in 307us (1266us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1788521806.381166:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:1.0:1788521806.441962:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521806.442096:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799062272 00000100:00100000:2.0:1788521806.442110:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799062272 00000100:00100000:2.0:1788521806.443117:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 60 00000100:00100000:2.0:1788521806.443137:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+46:10403:x1875400799062272:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521806.443190:0:10083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521806.443218:0:10083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c0d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00a1f expref: -99 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521806.443344:0:10083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788521806.443499:0:10083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c0d8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a1f expref: 48 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.443516:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:2.0:1788521806.443520:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521806.443526:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c0d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a1f expref: 48 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.443554:0:10083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490bc00, rc 0) 00000100:00100000:2.0:1788521806.443647:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+47:10403:x1875400799062272:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 518us (1699us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1788521806.443656:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 60 00000100:00100000:1.0:1788521806.447433:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521806.448594:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799062400 00000100:00100000:2.0:1788521806.448611:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799062400 00000100:00100000:2.0:1788521806.449043:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 61 00000100:00100000:2.0:1788521806.449057:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+47:10403:x1875400799062400:12345-192.168.206.48@tcp:34:lfs.0 00010000:00010000:2.0:1788521806.449176:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c0e6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.449197:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c0e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.449211:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c0e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.449232:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c0ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.449239:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c0ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.449245:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c0ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.449359:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c0f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.449368:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.449375:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788521806.449423:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.449437:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c0e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.449453:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c0e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.449461:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c0e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.449467:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490bc00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521806.449472:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c0e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.449480:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c0e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.449503:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:2.0:1788521806.449507:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521806.449513:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c0e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.449519:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c0e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.449534:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c0ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.449550:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c0ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.449556:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c0ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.449561:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490b200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521806.449570:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c0ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.449578:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c0ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.449586:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996fb19efa00) 00010000:00010000:2.0:1788521806.449588:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521806.449592:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c0ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.449598:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c0ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.449616:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.449621:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c0f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.449627:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c0f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.449632:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490ae00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521806.449635:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c0f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.449641:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c0f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.449648:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687e000) 00010000:00010000:2.0:1788521806.449650:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521806.449659:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c0f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.449675:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c0f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521806.449794:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+47:10403:x1875400799062400:12345-192.168.206.48@tcp:34:lfs.0 Request processed in 738us (2367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521806.449802:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 61 00000100:00100000:0.0:1788521806.452532:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521806.452685:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799062656 00000100:00100000:2.0:1788521806.452697:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799062656 00000100:00100000:2.0:1788521806.452780:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:2.0:1788521806.452792:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+47:10403:x1875400799062656:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:2.0:1788521806.453098:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+48:10403:x1875400799062656:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 307us (578us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788521806.453107:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:1.0:1788521806.481738:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521806.482188:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799062912 00000100:00100000:3.0:1788521806.482202:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799062912 00000100:00100000:3.0:1788521806.482284:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 62 00000100:00100000:3.0:1788521806.482296:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+48:10406:x1875400799062912:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521806.482327:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521806.482354:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c0fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00a26 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.482451:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c102 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.482485:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c102 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.482500:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c102 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.482520:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c109 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.482528:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.482534:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.484663:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c110 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.484681:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c110 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.484693:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c110 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521806.484707:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788521806.484829:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c102 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.484839:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c102 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.484943:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c102 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.484965:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392c400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521806.484970:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c102 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.485100:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c102 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.485118:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:3.0:1788521806.485122:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521806.485129:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c102 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.485135:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c102 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.485177:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.485184:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c109 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.485190:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c109 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.485195:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392c800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521806.485197:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c109 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.485202:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c109 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.485221:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996f8687eb00) 00010000:00010000:3.0:1788521806.485224:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521806.485226:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c109 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.485232:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c109 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.485295:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c0fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a26 expref: 51 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.485311:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c110 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a26 expref: 50 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.485319:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687e000) 00010000:00010000:3.0:1788521806.485321:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521806.485324:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f80031400, rc 0) 00000100:00100000:3.0:1788521806.485494:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+50:10406:x1875400799062912:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 3198us (3768us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1788521806.485504:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 62 00000100:00100000:1.0:1788521806.488221:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521806.488290:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521806.488391:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799063040 00000100:00100000:0.0:1788521806.488403:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799063040 00000100:00100000:0.0:1788521806.488486:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 63 00000100:00100000:0.0:1788521806.488499:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+50:10406:x1875400799063040:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:0.0:1788521806.488596:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ca00/0x1b7b50db5927c11e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.488615:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ca00/0x1b7b50db5927c11e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.488629:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ca00/0x1b7b50db5927c11e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.488660:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ca00/0x1b7b50db5927c11e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.488669:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ca00/0x1b7b50db5927c11e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.488676:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ca00/0x1b7b50db5927c11e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.488682:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fc217ca00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521806.488687:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ca00/0x1b7b50db5927c11e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.488695:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ca00/0x1b7b50db5927c11e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.488708:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687e000) 00010000:00010000:0.0:1788521806.488712:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788521806.488725:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ca00/0x1b7b50db5927c11e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.488732:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ca00/0x1b7b50db5927c11e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521806.488821:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+50:10406:x1875400799063040:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 324us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521806.488829:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 63 00000100:00100000:3.0:1788521806.489057:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799063168 00000100:00100000:3.0:1788521806.489063:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799063168 00000100:00100000:3.0:1788521806.489109:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:3.0:1788521806.489118:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb78a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+50:2363:x1875400799063168:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521806.489130:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521806.489176:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c110 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a26 expref: 50 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.489203:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687e000) 00010000:00010000:3.0:1788521806.489207:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521806.489238:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb78a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+49:2363:x1875400799063168:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 122us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521806.489245:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:1.0:1788521806.492036:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521806.492184:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799063424 00000100:00100000:3.0:1788521806.492197:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799063424 00000100:00100000:3.0:1788521806.492277:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:3.0:1788521806.492290:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb78a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+49:10406:x1875400799063424:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:3.0:1788521806.492726:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb78a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+50:10406:x1875400799063424:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 368us (638us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788521806.492736:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:0.0:1788521806.610600:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521806.610745:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799063680 00000100:00100000:2.0:1788521806.610759:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799063680 00000100:00100000:2.0:1788521806.610832:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 64 00000100:00100000:2.0:1788521806.610843:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+50:10424:x1875400799063680:12345-192.168.206.48@tcp:101:cat.0 00010000:00010000:2.0:1788521806.610875:0:10083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521806.610902:0:10083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c125 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00a2d expref: -99 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.611032:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c12c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.611049:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c12c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.611088:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c12c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521806.611102:0:10083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788521806.611311:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c125 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a2d expref: 53 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.611334:0:10083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c12c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a2d expref: 52 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521806.611344:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687e000) 00010000:00010000:2.0:1788521806.611348:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788521806.611352:0:10083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490b200, rc 0) 00000100:00100000:2.0:1788521806.611429:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+52:10424:x1875400799063680:12345-192.168.206.48@tcp:101:cat.0 Request processed in 587us (844us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788521806.611438:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 64 00000100:00100000:1.0:1788521806.633746:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521806.633856:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799063808 00000100:00100000:0.0:1788521806.633869:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799063808 00000100:00100000:0.0:1788521806.633946:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 65 00000100:00100000:0.0:1788521806.633958:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb78a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+52:10425:x1875400799063808:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1788521806.633988:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521806.634015:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ca00/0x1b7b50db5927c13a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00a34 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.634103:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217c000/0x1b7b50db5927c141 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.634121:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217c000/0x1b7b50db5927c141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.634135:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217c000/0x1b7b50db5927c141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521806.634214:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788521806.634218:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788521806.634243:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217c000/0x1b7b50db5927c141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.634295:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ca00/0x1b7b50db5927c13a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a34 expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.634317:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217c000/0x1b7b50db5927c141 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a34 expref: 53 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.634327:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:0.0:1788521806.634331:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788521806.634336:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fc217c000, rc 0) 00000100:00100000:0.0:1788521806.634409:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb78a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+53:10425:x1875400799063808:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 453us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521806.634416:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 65 00000100:00100000:1.0:1788521806.640217:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521806.640399:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799064192 00000100:00100000:2.0:1788521806.640412:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799064192 00000100:00100000:2.0:1788521806.640481:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:2.0:1788521806.640492:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb78a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+53:10425:x1875400799064192:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:2.0:1788521806.640922:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb78a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+54:10425:x1875400799064192:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 432us (719us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788521806.640931:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:3.0:1788521806.642894:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521806.643235:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799064320 00000100:00100000:0.0:1788521806.643247:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799064320 00000100:00100000:0.0:1788521806.643321:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:0.0:1788521806.643333:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc441180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+54:10425:x1875400799064320:12345-192.168.206.48@tcp:103:lfs.0 00010000:00010000:0.0:1788521806.643351:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788521806.643383:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c0d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a18 expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.643411:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c12c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a2d expref: 53 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.643424:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927bfdc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009d9 expref: 52 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.643465:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687e000) 00010000:00010000:0.0:1788521806.643479:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521806.643553:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc441180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+51:10425:x1875400799064320:12345-192.168.206.48@tcp:103:lfs.0 Request processed in 222us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521806.643561:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:1.0:1788521806.650353:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521806.652287:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799064448 00000100:00100000:3.0:1788521806.652304:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799064448 00000100:00100000:3.0:1788521806.652388:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 66 00000100:00100000:3.0:1788521806.652399:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb78a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+51:10425:x1875400799064448:12345-192.168.206.48@tcp:58:lfs.0 00010000:00010000:3.0:1788521806.652559:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c148 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.652578:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c148 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521806.652591:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c148 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788521806.652915:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788521806.653112:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1788521806.656358:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1788521806.656565:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb78a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+51:10425:x1875400799064448:12345-192.168.206.48@tcp:58:lfs.0 Request processed in 4159us (6218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521806.656580:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 66 00000100:00100000:1.0:1788521806.681113:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521806.681598:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799064576 00000100:00100000:0.0:1788521806.681611:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799064576 00000100:00100000:0.0:1788521806.681683:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 67 00000100:00100000:0.0:1788521806.681695:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb78a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+51:10427:x1875400799064576:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1788521806.681722:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521806.681748:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217d600/0x1b7b50db5927c14f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00a3b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.681828:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ce00/0x1b7b50db5927c156 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.681846:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ce00/0x1b7b50db5927c156 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.681859:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ce00/0x1b7b50db5927c156 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.681877:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217da00/0x1b7b50db5927c15d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.681884:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217da00/0x1b7b50db5927c15d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.681913:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217da00/0x1b7b50db5927c15d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.682020:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ca00/0x1b7b50db5927c164 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.682030:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ca00/0x1b7b50db5927c164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.682037:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ca00/0x1b7b50db5927c164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521806.682080:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788521806.682084:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788521806.682105:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ca00/0x1b7b50db5927c164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.682119:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ca00/0x1b7b50db5927c164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.682128:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ce00/0x1b7b50db5927c156 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.682135:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ce00/0x1b7b50db5927c156 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.682189:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ce00/0x1b7b50db5927c156 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.682196:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fc217ce00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521806.682201:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ce00/0x1b7b50db5927c156 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.682216:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ce00/0x1b7b50db5927c156 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.682230:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:0.0:1788521806.682234:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521806.682240:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ce00/0x1b7b50db5927c156 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.682246:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ce00/0x1b7b50db5927c156 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.682264:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217da00/0x1b7b50db5927c15d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.682270:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217da00/0x1b7b50db5927c15d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.682277:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217da00/0x1b7b50db5927c15d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.682282:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fc217da00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521806.682285:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217da00/0x1b7b50db5927c15d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.682292:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217da00/0x1b7b50db5927c15d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.682299:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996f83d6d000) 00010000:00010000:0.0:1788521806.682302:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521806.682305:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217da00/0x1b7b50db5927c15d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.682321:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217da00/0x1b7b50db5927c15d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.682358:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217d600/0x1b7b50db5927c14f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a3b expref: 53 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.682372:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ca00/0x1b7b50db5927c164 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a3b expref: 52 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521806.682380:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687eb00) 00010000:00010000:0.0:1788521806.682383:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788521806.682386:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fc217ca00, rc 0) 00000100:00100000:0.0:1788521806.682466:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb78a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+52:10427:x1875400799064576:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 774us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521806.682473:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 67 00010000:00010000:2.0:1788521806.992290:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788521807.060576:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788521807.060588:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788521807.060657:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788521807.060666:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788521807.060825:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85dc2a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1875400816914560:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788521807.060995:0:11682:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f8324c600 going to sleep for 11 seconds 00000100:00100000:0.0:1788521807.077385:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85dc2a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1875400816914560:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788521807.078295:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521807.078704:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799064704 00000100:00100000:2.0:1788521807.078714:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799064704 00000100:00080000:1.0:1788521807.078840:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521807.078951:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:2.0:1788521807.078963:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb78a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4bd13e8f-aac9-42ad-8625-a542705d6920+52:10438:x1875400799064704:12345-192.168.206.48@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788521807.079066:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb78a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4bd13e8f-aac9-42ad-8625-a542705d6920+52:10438:x1875400799064704:12345-192.168.206.48@tcp:900:lhsmtool_posix.0 Request processed in 105us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521807.079074:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:1.0:1788521807.089386:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521807.089481:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799064832 00000100:00100000:0.0:1788521807.089493:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799064832 00000100:00100000:0.0:1788521807.089579:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 68 00000100:00100000:0.0:1788521807.089591:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb78a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+52:10438:x1875400799064832:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788521807.089643:0:10083:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788521807.089779:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb78a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+52:10438:x1875400799064832:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 190us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521807.089787:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 68 00000100:00100000:1.0:1788521807.096222:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521807.096311:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799064960 00000100:00100000:2.0:1788521807.096324:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799064960 00000100:00100000:2.0:1788521807.096389:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 69 00000100:00100000:2.0:1788521807.096400:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb78a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+52:10438:x1875400799064960:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788521807.096489:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c16b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.096510:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c16b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.096543:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c16b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.096563:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c172 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.096571:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c172 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.096578:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c172 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.096610:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c179 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.096633:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.096640:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521807.096688:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788521807.096693:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521807.096708:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.096720:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c16b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.096727:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c16b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.096734:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c16b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.096741:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490ae00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521807.096746:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c16b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.096755:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c16b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.096768:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996fb19efc00) 00010000:00010000:2.0:1788521807.096771:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521807.096777:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c16b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.096793:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c16b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.096808:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c172 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.096814:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c172 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.096820:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c172 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.096824:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490bc00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521807.096827:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c172 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.096834:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c172 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.096841:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff996fb19efa00) 00010000:00010000:2.0:1788521807.096844:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521807.096847:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c172 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.096853:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c172 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.096869:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.096874:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c179 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.096887:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c179 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.096892:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490a400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521807.096895:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c179 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.096901:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c179 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.096910:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687eb00) 00010000:00010000:2.0:1788521807.096913:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521807.096915:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c179 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.096921:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c179 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521807.097012:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb78a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+52:10438:x1875400799064960:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 Request processed in 612us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521807.097021:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 69 00000100:00100000:1.0:1788521807.099944:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521807.100029:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799065216 00000100:00100000:2.0:1788521807.100040:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799065216 00000100:00100000:2.0:1788521807.100107:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 70 00000100:00100000:2.0:1788521807.100117:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb78a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+52:10438:x1875400799065216:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521807.100175:0:10083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521807.100202:0:10083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c180 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00a42 expref: -99 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.100342:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c187 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.100359:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.100372:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521807.100385:0:10083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788521807.100505:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.100514:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c187 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.100521:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.100527:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490a200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521807.100532:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.100553:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c187 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.100575:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687eb00) 00010000:00010000:2.0:1788521807.100578:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788521807.100584:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c187 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.100602:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c187 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.100654:0:10083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c180 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a42 expref: 54 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.100665:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996fb19efc00) 00010000:00010000:2.0:1788521807.100668:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521807.100672:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c180 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a42 expref: 54 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.100682:0:10083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490b600, rc 0) 00000100:00100000:2.0:1788521807.100749:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb78a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+53:10438:x1875400799065216:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 633us (818us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1788521807.100757:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 70 00000100:00100000:1.0:1788521807.113979:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521807.114185:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799065344 00000100:00100000:3.0:1788521807.114198:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799065344 00000100:00100000:3.0:1788521807.114268:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 71 00000100:00100000:3.0:1788521807.114280:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb78a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+53:10438:x1875400799065344:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788521807.114342:0:5835:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788521807.114475:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb78a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+53:10438:x1875400799065344:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 197us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521807.114483:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 71 00000100:00100000:3.0:1788521807.117937:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521807.117995:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799065600 00000100:00100000:0.0:1788521807.118007:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799065600 00000100:00100000:0.0:1788521807.118084:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 72 00000100:00100000:0.0:1788521807.118098:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+53:10438:x1875400799065600:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788521807.118125:0:10083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521807.118129:0:10083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788521807.118183:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217c000/0x1b7b50db5927c141 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a34 expref: 53 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.118205:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:0.0:1788521807.118211:0:10083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788521807.118228:0:10083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217d600/0x1b7b50db5927c195 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00a49 expref: -99 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788521807.119040:0:10083:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788521807.119329:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217da00/0x1b7b50db5927c19c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.119346:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217da00/0x1b7b50db5927c19c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.119359:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217da00/0x1b7b50db5927c19c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.119445:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217d600/0x1b7b50db5927c195 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a49 expref: 55 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.119464:0:10083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217da00/0x1b7b50db5927c19c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a49 expref: 54 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.119472:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff996f83d6d000) 00010000:00010000:0.0:1788521807.119475:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788521807.119478:0:10083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fc217da00, rc 0) 00000100:00100000:0.0:1788521807.119725:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+54:10438:x1875400799065600:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 1629us (1800us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1788521807.119735:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 72 00000100:00100000:3.0:1788521807.122716:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521807.122867:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799065856 00000100:00100000:0.0:1788521807.122880:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799065856 00000100:00100000:0.0:1788521807.122949:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 73 00000100:00100000:0.0:1788521807.122961:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+54:10438:x1875400799065856:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788521807.123038:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521807.123072:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217da00/0x1b7b50db5927c19c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a49 expref: 54 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.123094:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff996f83d6d000) 00010000:00010000:0.0:1788521807.123107:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788521807.123135:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ce00/0x1b7b50db5927c1aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.123181:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ce00/0x1b7b50db5927c1aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.123202:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ce00/0x1b7b50db5927c1aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.123235:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c1b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x9228f44d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.123243:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c1b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9228f44d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.123249:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c1b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9228f44d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.123327:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ce00/0x1b7b50db5927c1aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.123335:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ce00/0x1b7b50db5927c1aa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.123341:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ce00/0x1b7b50db5927c1aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.123347:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fc217ce00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521807.123352:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ce00/0x1b7b50db5927c1aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.123359:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ce00/0x1b7b50db5927c1aa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.123368:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:0.0:1788521807.123372:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521807.123376:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ce00/0x1b7b50db5927c1aa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.123390:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ce00/0x1b7b50db5927c1aa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.123401:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c1b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9228f44d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.123407:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c1b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9228f44d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.123413:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c1b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9228f44d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.123418:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521807.123423:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c1b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9228f44d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.123429:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c1b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9228f44d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.123437:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x9228f44d (ffff996f83d6dd00) 00010000:00010000:0.0:1788521807.123440:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521807.123442:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c1b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9228f44d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.123448:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c1b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9228f44d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521807.123551:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+53:10438:x1875400799065856:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 592us (848us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788521807.123559:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 73 00000100:00100000:1.0:1788521807.128382:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521807.128529:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799065984 00000100:00100000:3.0:1788521807.128553:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799065984 00000100:00100000:3.0:1788521807.128629:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 74 00000100:00100000:3.0:1788521807.128643:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb78a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+53:10438:x1875400799065984:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521807.128670:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521807.128700:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c1b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00a50 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.128745:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c1bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.128775:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c1bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.128789:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c1bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.128974:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c1b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a50 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.128994:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c1bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a50 expref: 54 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.129003:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff996f8687ea00) 00010000:00010000:3.0:1788521807.129006:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788521807.129011:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f80031a00, rc 0) 00000100:00100000:3.0:1788521807.129087:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb78a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+54:10438:x1875400799065984:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 448us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521807.129094:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 74 00000100:00100000:1.0:1788521807.132103:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521807.132795:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799066240 00000100:00100000:3.0:1788521807.132808:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799066240 00000100:00100000:3.0:1788521807.132930:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 75 00000100:00100000:3.0:1788521807.132943:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb78a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+54:10438:x1875400799066240:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788521807.133054:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c1c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.133075:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c1c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.133105:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c1c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788521807.133481:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788521807.133493:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 307118349343ns, next at 308118346388ns, rc = 0 00000004:00010000:3.0:1788521807.133621:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd536141 reply state 00000000af7ac76a transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c1c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521807.133631:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788521807.133745:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb78a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+56:10438:x1875400799066240:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 804us (1653us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788521807.133753:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 75 00010000:00010000:0.0:1788521807.135913:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c1c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.135933:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c1c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.135941:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c1c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.135948:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80030400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521807.135955:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c1c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.135964:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c1c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.135986:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff996f8687ea00) 00010000:00010000:0.0:1788521807.136001:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788521807.136008:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c1c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.136016:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c1c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521807.136685:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521807.137382:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799066368 00000100:00100000:0.0:1788521807.137397:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799066368 00000100:00100000:0.0:1788521807.137471:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 76 00000100:00100000:0.0:1788521807.137483:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+55:10438:x1875400799066368:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788521807.137513:0:10083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521807.137548:0:10083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c1cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00a57 expref: -99 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.137653:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c1cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a57 expref: 56 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.137671:0:10083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c1cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a57 expref: 56 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.137694:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff996f8687ea00) 00010000:00010000:0.0:1788521807.137697:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788521807.137701:0:10083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4000c00, rc 0) 00000100:00100000:0.0:1788521807.137761:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+56:10438:x1875400799066368:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 280us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521807.137769:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 76 00000100:00100000:1.0:1788521807.139905:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521807.141825:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799066496 00000100:00100000:2.0:1788521807.141843:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799066496 00000100:00100000:2.0:1788521807.141907:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 24 00000100:00100000:2.0:1788521807.141918:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb78a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1875400799066496:12345-192.168.206.48@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788521807.141958:0:6687:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4bd13e8f-aac9-42ad-8625-a542705d6920@192.168.206.48@tcp t0 exp 0000000000000000 cur 307 last 0 00000020:00000080:2.0:1788521807.141995:0:6687:0:(genops.c:1385:class_connect()) connect: client 4bd13e8f-aac9-42ad-8625-a542705d6920, cookie 0x1b7b50db5927c1d4 00002000:00100000:2.0:1788521807.142010:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4bd13e8f-aac9-42ad-8625-a542705d6920/ffff996fb46eb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788521807.142023:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788521807.142390:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788521807.142439:0:6687:0:(import.c:65:import_set_state_nolock()) ffff996fb46ed000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788521807.142565:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb78a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2360:x1875400799066496:12345-192.168.206.48@tcp:8:lhsmtool_posix.0 Request processed in 647us (2668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521807.142574:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 24 00000100:00100000:1.0:1788521807.146328:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521807.146440:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799066624 00000100:00100000:3.0:1788521807.146453:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799066624 00000100:00100000:3.0:1788521807.146554:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 25 00000100:00100000:3.0:1788521807.146570:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb78a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+6:0:x1875400799066624:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788521807.147004:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521807.183526:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb78a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+7:0:x1875400799066624:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 36952us (37201us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788521807.183552:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 25 00000001:00100000:1.0:1788521807.183729:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4bd13e8f-aac9-42ad-8625-a542705d6920 00000001:00080000:1.0:1788521807.183745:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:3.0:1788521807.190924:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521807.191795:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799066880 00000100:00100000:0.0:1788521807.191808:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799066880 00000100:00100000:0.0:1788521807.191885:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:0.0:1788521807.191897:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+56:10438:x1875400799066880:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788521807.192225:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+57:10438:x1875400799066880:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 330us (1314us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788521807.192235:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:1.0:1788521807.198341:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521807.199321:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799067136 00000100:00100000:0.0:1788521807.199335:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799067136 00000100:00100000:0.0:1788521807.199414:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 77 00000100:00100000:0.0:1788521807.199427:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb78a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+57:10438:x1875400799067136:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788521807.199585:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb78a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+57:10438:x1875400799067136:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 161us (1255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521807.199602:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 77 00000100:00100000:2.0:1788521807.207066:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521807.207125:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799067264 00000100:00100000:2.0:1788521807.207137:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799067264 00000100:00100000:2.0:1788521807.207220:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 78 00000100:00100000:2.0:1788521807.207233:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+57:10438:x1875400799067264:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521807.207262:0:10083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521807.207293:0:10083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c1db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00a5e expref: -99 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.207410:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c1e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.207428:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c1e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.207442:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c1e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521807.207487:0:10083:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521807.207508:0:10083:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c1e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.207551:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c1db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a5e expref: 59 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.207572:0:10083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c1e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a5e expref: 58 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.207596:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff996f8687ea00) 00010000:00010000:2.0:1788521807.207599:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788521807.207604:0:10083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490bc00, rc 0) 00000100:00100000:2.0:1788521807.207674:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+58:10438:x1875400799067264:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 443us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521807.207681:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 78 00000100:00100000:0.0:1788521807.213123:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521807.215277:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799067392 00000100:00100000:2.0:1788521807.215294:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799067392 00000100:00100000:2.0:1788521807.215366:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 26 00000100:00100000:2.0:1788521807.215378:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2363:x1875400799067392:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521807.215400:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521807.215426:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002792d343/0x1b7b50db5927c1e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00a65 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788521807.215461:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9aad4f, blocks: 0x1 00010000:00010000:2.0:1788521807.215484:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=307s v=(0 0) 00010000:00010000:2.0:1788521807.215489:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521807.215501:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002792d343/0x1b7b50db5927c1e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a65 expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.215523:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002792d343/0x1b7b50db5927c1e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a65 expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.215552:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490ac00, rc 0) 00000100:00100000:2.0:1788521807.215641:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2363:x1875400799067392:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 265us (2532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521807.215649:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 26 00000100:00100000:1.0:1788521807.226949:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521807.227081:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799067648 00000100:00100000:0.0:1788521807.227095:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799067648 00000100:00100000:0.0:1788521807.227181:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 79 00000100:00100000:0.0:1788521807.227193:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb78a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+58:10438:x1875400799067648:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788521807.227327:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb78a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+58:10438:x1875400799067648:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 136us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521807.227335:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 79 00000100:00100000:0.0:1788521807.231018:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521807.231097:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799067776 00000100:00100000:1.0:1788521807.231110:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799067776 00000100:00100000:1.0:1788521807.231228:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:1.0:1788521807.231241:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+6:10438:x1875400799067776:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788521807.231265:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521807.231300:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebd61a0b/0x1b7b50db5927c1f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00a6c expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521807.231344:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002792d343/0x1b7b50db5927c1e9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a65 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521807.231355:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521807.231360:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521807.231367:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebd61a0b/0x1b7b50db5927c1f0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a6c expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521807.231424:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002792d343/0x1b7b50db5927c1e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a65 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521807.231450:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002792d343/0x1b7b50db5927c1e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a65 expref: 7 pid: 6689 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521807.231467:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb78a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6690:1875400816914688:192.168.206.48@tcp:104: 00000100:00100000:1.0:1788521807.231662:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cb180 going to sleep for 11 seconds 00000100:00100000:3.0:1788521807.241411:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb78a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6690:1875400816914688:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788521807.241469:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ebd61a0b/0x1b7b50db5927c1f0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a6c expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.241498:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d4600, rc 0) 00000100:00100000:3.0:1788521807.241647:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+7:10438:x1875400799067776:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 10408us (10656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521807.241657:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:1.0:1788521807.250848:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521807.251297:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799067904 00000100:00100000:2.0:1788521807.251309:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799067904 00010000:00010000:2.0:1788521807.251375:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002792d343/0x1b7b50db5927c1e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a65 expref: 7 pid: 6689 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521807.251421:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 42 00000100:00100000:2.0:1788521807.251433:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f856e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2363:x1875400799067904:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521807.251451:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521807.251480:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002792d343/0x1b7b50db5927c1e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a65 expref: 7 pid: 6689 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.251506:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002792d343/0x1b7b50db5927c1e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a65 expref: 7 pid: 6689 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.251731:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002792d343/0x1b7b50db5927c1e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a65 expref: 7 pid: 6689 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.251753:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521807.251757:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521807.251767:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ebd61a0b/0x1b7b50db5927c1f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a6c expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.251777:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebd61a0b/0x1b7b50db5927c1f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a6c expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.251849:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ebd61a0b/0x1b7b50db5927c1f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a6c expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521807.251866:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc3ec000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5818:1875400816914816:192.168.206.48@tcp:105: 00000100:00100000:2.0:1788521807.251961:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86989d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521807.264678:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc3ec000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5818:1875400816914816:192.168.206.48@tcp:105: 00010000:00010000:2.0:1788521807.264717:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521807.264800:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f856e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2363:x1875400799067904:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 13367us (13964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521807.264813:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 42 00000100:00100000:3.0:1788521807.267456:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521807.267664:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799068032 00000100:00100000:2.0:1788521807.267680:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799068032 00002000:00100000:2.0:1788521807.267821:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff996fb3f59f80 x1875400799068032/t0(0) o4->4bd13e8f-aac9-42ad-8625-a542705d6920@192.168.206.48@tcp:53/0 lens 504/0 e 0 to 0 dl 1788521818 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788521807.267833:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff996fb3f59f80 with x1875400799068032 ext(0->8) 00002000:00010000:2.0:1788521807.267840:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996fb3f59f80 00000100:00100000:2.0:1788521807.267877:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:2.0:1788521807.267889:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2364:x1875400799068032:12345-192.168.206.48@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788521807.269179:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+8:2364:x1875400799068032:12345-192.168.206.48@tcp:4:lhsmtool_posix.0 Request processed in 1251us (2320us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788521807.269193:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 0 00002000:00100000:2.0:1788521807.269282:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff996fb3f59f80 x1875400799068032/t4294967302(0) o4->4bd13e8f-aac9-42ad-8625-a542705d6920@192.168.206.48@tcp:53/0 lens 504/448 e 0 to 0 dl 1788521818 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788521807.269307:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff996fb3f59f80 with x1875400799068032 ext(0->8) 00002000:00010000:2.0:1788521807.269316:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996fb3f59f80 00000100:00100000:3.0:1788521807.277634:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521807.280383:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799068160 00000100:00100000:1.0:1788521807.280406:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799068160 00000100:00100000:1.0:1788521807.280514:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 80 00000100:00100000:1.0:1788521807.280527:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb42d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+58:10438:x1875400799068160:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788521807.337967:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:0.0:1788521807.337995:0:5856:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff996fad7b3480 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788521807.338001:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff996f888a3000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff996fad7b3180 00000020:00080000:0.0:1788521807.338004:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff996f888a3e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff996fbfc77c00 00000004:00080000:0.0:1788521807.338068:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:0.0:1788521807.338092:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:1.0:1788521807.338132:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb42d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+26:10438:x1875400799068160:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 Request processed in 57558us (60464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521807.338227:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 80 00000020:00080000:2.0:1788521807.338255:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:0.0:1788521807.338397:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad92aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816914944:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788521807.338477:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788521807.338502:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788521807.338577:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816915072:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788521807.338607:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521807.338659:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816914944 00000100:00100000:0.0:1788521807.338668:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816914944 00000100:00100000:0.0:1788521807.338724:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816915072 00000100:00100000:0.0:1788521807.338728:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816915072 00000100:00100000:0.0:1788521807.338751:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788521807.338769:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad92a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875400816914944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788521807.338801:0:6689:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00000100:00100000:2.0:1788521807.339428:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788521807.339441:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad92bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816915072:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788521807.339630:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788521807.339634:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788521807 00002000:00010000:2.0:1788521807.339637:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788521807.339638:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788521807 -> 1788521807 00002000:00010000:2.0:1788521807.339641:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788521807.339702:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad92bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1875400816915072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 265us (1094us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788521807.339710:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00002000:00010000:0.0:1788521807.340300:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9aad4d, atime: 0x6a9aad4d, ctime: 0x6a9aad4d, blocks: 0x1 00010000:00010000:0.0:1788521807.340312:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b70617ee/0x1b7b50db5927c1f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.340331:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=307s v=(0 0) 00010000:00010000:0.0:1788521807.340336:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521807.340343:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b70617ee/0x1b7b50db5927c1f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.340365:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b70617ee/0x1b7b50db5927c1f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.340378:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b70617ee/0x1b7b50db5927c1f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.340385:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b70617ee/0x1b7b50db5927c1f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.340412:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788521807.341939:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00010000:00010000:2.0:1788521807.341958:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521807.341969:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b70617ee/0x1b7b50db5927c1f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.341983:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000800 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:2.0:1788521807.341988:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b70617ee/0x1b7b50db5927c1f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.341999:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b70617ee/0x1b7b50db5927c1f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521807.342004:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799068288 00000100:00100000:1.0:1788521807.342014:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799068288 00010000:00010000:2.0:1788521807.342033:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b70617ee/0x1b7b50db5927c1f7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521807.342041:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b70617ee/0x1b7b50db5927c1f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521807.342063:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 30 00010000:00010000:2.0:1788521807.342067:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521807.342069:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521807.342070:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521807.342074:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb78a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+8:2364:x1875400799068288:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 00000100:00080000:1.0:1788521807.344229:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788521807.344663:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad92a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1875400816914944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5887us (6177us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788521807.344689:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:0.0:1788521807.345528:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff996fad928a80/2, rc 0, transno 4294967303 00000100:00100000:0.0:1788521807.345557:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816915072:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1788521807.345619:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff996fad92aa00/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788521807.345624:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad92aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816914944:0@lo:6:osp-syn-1-0.0 00000040:00080000:3.0:1788521807.356444:0:12001:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788521807.356456:0:12001:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788521807.356502:0:12001:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788521807.356511:0:12001:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1788521807.384318:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1788521807.384339:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1788521807.384362:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb78a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2364:x1875400799068288:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 Request processed in 42280us (42424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521807.384386:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 30 00000100:00100000:2.0:1788521807.386199:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521807.386463:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799068544 00000100:00100000:0.0:1788521807.386474:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799068544 00000100:00100000:0.0:1788521807.386677:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 81 00000100:00100000:0.0:1788521807.386691:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+13:10438:x1875400799068544:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788521807.386760:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521807.386806:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c1e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a5e expref: 13 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.386825:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff996f8687ea00) 00010000:00010000:0.0:1788521807.386831:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788521807.386870:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c1fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.386888:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c1fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.386901:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c1fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788521807.387262:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007dfdac9a reply state 000000007a0ab69a transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c1fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521807.387273:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788521807.387476:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+14:10438:x1875400799068544:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 785us (1283us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788521807.387485:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 81 00000100:00100000:0.0:1788521807.391935:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521807.392010:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799068672 00000100:00100000:1.0:1788521807.392025:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799068672 00000100:00100000:1.0:1788521807.392102:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 31 00000100:00100000:1.0:1788521807.392115:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad929c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2363:x1875400799068672:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00010000:00010000:3.0:1788521807.392307:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c1fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.392321:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c1fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.392329:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c1fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.392336:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4001000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521807.392343:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c1fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.392352:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c1fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.392373:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff996f8687ea00) 00010000:00010000:3.0:1788521807.392376:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521807.392382:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c1fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.392389:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c1fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788521807.392470:0:11097:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788521807.392474:0:11097:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788521807 -> 1788521806 00002000:00010000:1.0:1788521807.392477:0:11097:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788521805 00002000:00010000:1.0:1788521807.392479:0:11097:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788521807 -> 1788521806 00002000:00010000:1.0:1788521807.392481:0:11097:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788521807.392568:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad929c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2363:x1875400799068672:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 454us (641us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788521807.392577:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 31 00000100:00100000:1.0:1788521807.402750:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521807.405300:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799068928 00000100:00100000:3.0:1788521807.405322:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799068928 00000100:00100000:3.0:1788521807.405489:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 82 00000100:00100000:3.0:1788521807.405503:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb78a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+13:10438:x1875400799068928:12345-192.168.206.48@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788521807.405609:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c205 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.405630:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c1bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a50 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.405642:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c205 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.405697:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c1bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a50 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.405721:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c1bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a50 expref: 13 pid: 5833 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521807.405739:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb42da300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1875400816915200:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788521807.407958:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86989900 going to sleep for 11 seconds 00000100:00100000:3.0:1788521807.410495:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521807.410639:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb42da300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1875400816915200:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788521807.410680:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c205 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521807.411139:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799069056 00000100:00100000:1.0:1788521807.411163:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799069056 00010000:00010000:1.0:1788521807.411213:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c1bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a50 expref: 14 pid: 5833 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521807.411261:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 43 00000100:00100000:1.0:1788521807.411272:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb42dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+14:2364:x1875400799069056:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521807.411290:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521807.411298:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c1bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a50 expref: 14 pid: 5833 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521807.411334:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c1bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a50 expref: 14 pid: 5833 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521807.411361:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c1bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a50 expref: 14 pid: 5833 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521807.411379:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff996f8687ea00) 00010000:00010000:1.0:1788521807.411384:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c205 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521807.411395:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c205 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521807.411404:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c205 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521807.411435:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788521807.411582:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c205 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.411590:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c205 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.411637:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c205 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.411646:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c205 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.411652:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c205 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.411658:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80030600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521807.411664:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c205 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.411733:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c205 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.411745:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff996f8687ea00) 00010000:00010000:3.0:1788521807.411748:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788521807.411752:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c205 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.411828:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c205 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521807.411928:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb78a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+13:10438:x1875400799068928:12345-192.168.206.48@tcp:55:lhsmtool_posix.0 Request processed in 6427us (9192us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788521807.411939:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 82 00000100:00100000:1.0:1788521807.413813:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb42dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+12:2364:x1875400799069056:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 2536us (3323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521807.413826:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 43 00000100:00100000:3.0:1788521807.418195:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521807.418245:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799069184 00000100:00100000:3.0:1788521807.418257:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799069184 00000100:00100000:3.0:1788521807.418353:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 32 00000100:00100000:3.0:1788521807.418366:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb42d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2364:x1875400799069184:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788521807.418775:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fdaebd70/0x1b7b50db5927c20c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.418804:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ebd61a0b/0x1b7b50db5927c1f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a6c expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.418815:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521807.418821:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521807.418826:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdaebd70/0x1b7b50db5927c20c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.418869:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ebd61a0b/0x1b7b50db5927c1f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a6c expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.418896:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ebd61a0b/0x1b7b50db5927c1f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a6c expref: 7 pid: 6690 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521807.418913:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb42dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6690:1875400816915328:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788521807.419018:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86989600 going to sleep for 11 seconds 00000100:00100000:3.0:1788521807.423033:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521807.423924:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799069312 00000100:00100000:1.0:1788521807.423937:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799069312 00010000:00010000:1.0:1788521807.423991:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ebd61a0b/0x1b7b50db5927c1f0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a6c expref: 8 pid: 6690 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521807.424049:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 44 00000100:00100000:1.0:1788521807.424060:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb42d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+8:2363:x1875400799069312:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521807.424089:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521807.424118:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ebd61a0b/0x1b7b50db5927c1f0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a6c expref: 8 pid: 6690 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521807.424158:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ebd61a0b/0x1b7b50db5927c1f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a6c expref: 8 pid: 6690 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521807.424196:0:7632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788521807.424201:0:7632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788521807.424209:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdaebd70/0x1b7b50db5927c20c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521807.424222:0:7632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdaebd70/0x1b7b50db5927c20c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521807.424247:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521807.424315:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb42d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+8:2363:x1875400799069312:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 255us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521807.424323:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 44 00010000:00010000:0.0:1788521807.424961:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebd61a0b/0x1b7b50db5927c1f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a6c expref: 7 pid: 6690 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521807.424984:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb42dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6690:1875400816915328:192.168.206.48@tcp:104: 00010000:00010000:0.0:1788521807.425016:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdaebd70/0x1b7b50db5927c20c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.425030:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdaebd70/0x1b7b50db5927c20c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.425038:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdaebd70/0x1b7b50db5927c20c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.425074:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fdaebd70/0x1b7b50db5927c20c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.425084:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdaebd70/0x1b7b50db5927c20c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.425092:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdaebd70/0x1b7b50db5927c20c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.425099:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80030600 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521807.425103:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdaebd70/0x1b7b50db5927c20c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.425124:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdaebd70/0x1b7b50db5927c20c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.425253:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdaebd70/0x1b7b50db5927c20c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.425263:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdaebd70/0x1b7b50db5927c20c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521807.425457:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb42d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2364:x1875400799069184:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 Request processed in 7091us (7275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521807.425468:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 32 00000100:00100000:3.0:1788521807.428827:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521807.429343:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799069568 00000100:00100000:0.0:1788521807.429357:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799069568 00000100:00100000:0.0:1788521807.429465:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 83 00000100:00100000:0.0:1788521807.429479:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb42d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+12:10438:x1875400799069568:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788521807.429708:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927c213 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.429735:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927c213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.429750:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927c213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.430048:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001a00/0x1b7b50db5927c21a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.430061:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c1cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a57 expref: 13 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.430084:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001a00/0x1b7b50db5927c21a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.430129:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c1cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a57 expref: 13 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.430206:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c1cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a57 expref: 13 pid: 10083 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521807.430224:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad92ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875400816915456:192.168.206.48@tcp:104: 00000100:00100000:1.0:1788521807.430388:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fad804900 going to sleep for 11 seconds 00000100:00100000:3.0:1788521807.445849:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521807.445965:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad92ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875400816915456:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788521807.446003:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001a00/0x1b7b50db5927c21a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521807.446451:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799069696 00000100:00100000:3.0:1788521807.446462:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799069696 00010000:00010000:3.0:1788521807.446513:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c1cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a57 expref: 14 pid: 10083 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521807.446575:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 45 00000100:00100000:3.0:1788521807.446588:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb42db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+14:2364:x1875400799069696:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521807.446608:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521807.446617:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c1cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a57 expref: 14 pid: 10083 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.446642:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c1cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a57 expref: 14 pid: 10083 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.446668:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c1cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a57 expref: 14 pid: 10083 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.446685:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff996f8687ea00) 00010000:00010000:3.0:1788521807.446690:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001a00/0x1b7b50db5927c21a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.446701:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001a00/0x1b7b50db5927c21a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.446710:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001a00/0x1b7b50db5927c21a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.446734:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521807.446798:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb42db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+13:2364:x1875400799069696:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 213us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521807.446806:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 45 00010000:00010000:1.0:1788521807.446994:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001a00/0x1b7b50db5927c21a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521807.447004:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001a00/0x1b7b50db5927c21a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788521807.447276:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1788521807.447457:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1788521807.447512:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1788521807.447650:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fadfcea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5834:1875400816915584:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788521807.447714:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521807.447755:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f91285300 going to sleep for 11 seconds 00000100:00100000:0.0:1788521807.447861:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816915584 00000100:00100000:0.0:1788521807.447869:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816915584 00000100:00100000:0.0:1788521807.447955:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521807.447964:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadfcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1875400816915584:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788521807.448060:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadfcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1875400816915584:12345-0@lo:1000:mdt00_001.0 Request processed in 97us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521807.448068:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788521807.448139:0:5834:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1788521807.448182:0:5834:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff996fad928a80, transno 4294967303 00000100:00100000:3.0:1788521807.448199:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fadfcea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5834:1875400816915584:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788521807.448885:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1788521807.448964:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb42db100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5834:1875400816915712:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788521807.449011:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521807.449031:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f98823540 going to sleep for 11 seconds 00000100:00100000:1.0:1788521807.449855:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816915712 00000100:00100000:1.0:1788521807.449865:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816915712 00000100:00100000:1.0:1788521807.449931:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788521807.449942:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb42d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5834:x1875400816915712:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788521807.450221:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb42d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5834:x1875400816915712:12345-0@lo:1000:mdt00_001.0 Request processed in 281us (1208us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788521807.450229:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788521807.450410:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb42db100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5834:1875400816915712:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788521807.450455:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001a00/0x1b7b50db5927c21a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.450467:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001a00/0x1b7b50db5927c21a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.450476:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001a00/0x1b7b50db5927c21a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.450482:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4001a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521807.450487:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001a00/0x1b7b50db5927c21a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.450496:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001a00/0x1b7b50db5927c21a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.450516:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff996f8687ea00) 00010000:00010000:3.0:1788521807.450520:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788521807.450525:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001a00/0x1b7b50db5927c21a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.450544:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001a00/0x1b7b50db5927c21a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.450599:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c148 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.450607:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c148 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.450613:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c148 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.450619:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80031400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521807.450622:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c148 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.450627:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c148 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.450637:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687eb00) 00010000:00010000:3.0:1788521807.450639:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788521807.450642:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c148 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.450648:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c148 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.450677:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c221 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.450693:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ca00/0x1b7b50db5927c164 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a3b expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.450704:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c221 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.450750:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ca00/0x1b7b50db5927c164 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a3b expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.450779:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ca00/0x1b7b50db5927c164 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a3b expref: 16 pid: 5834 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521807.450794:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb42d8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875400816915840:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788521807.450887:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f98823540 going to sleep for 11 seconds 00000100:00100000:1.0:1788521807.454049:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb42d8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875400816915840:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788521807.454095:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c221 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521807.456456:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521807.456618:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799069824 00000100:00100000:1.0:1788521807.456631:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799069824 00010000:00010000:1.0:1788521807.456681:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ca00/0x1b7b50db5927c164 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a3b expref: 17 pid: 5834 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521807.456782:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00100000:1.0:1788521807.456796:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb42da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+17:2363:x1875400799069824:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521807.456817:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521807.456825:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ca00/0x1b7b50db5927c164 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a3b expref: 17 pid: 5834 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521807.456862:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ca00/0x1b7b50db5927c164 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a3b expref: 17 pid: 5834 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521807.456891:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fc217ca00/0x1b7b50db5927c164 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a3b expref: 17 pid: 5834 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521807.456910:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687eb00) 00010000:00010000:1.0:1788521807.456916:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c221 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521807.456928:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c221 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521807.456937:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c221 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521807.457058:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521807.457129:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb42da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+16:2363:x1875400799069824:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 336us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521807.457139:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 46 00010000:00010000:0.0:1788521807.457167:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c221 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.457179:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c221 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.457199:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c221 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.457207:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c221 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.457222:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c221 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.457229:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80030600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521807.457234:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c221 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.457245:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c221 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.457256:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687eb00) 00010000:00010000:0.0:1788521807.457259:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521807.457264:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c221 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.457271:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c221 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.457284:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927c213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.457292:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927c213 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.457298:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927c213 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.457304:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521807.457307:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927c213 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.457326:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927c213 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.457336:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f8687eb00) 00010000:00010000:0.0:1788521807.457338:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788521807.457341:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927c213 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521807.457348:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927c213 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521807.457650:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb42d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+15:10438:x1875400799069568:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 28174us (28837us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1788521807.457661:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 83 00000020:00080000:0.0:1788521807.457666:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788521807.461053:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788521807.461067:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788521807.461109:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788521807.461119:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788521807.462551:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521807.462673:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799070080 00000100:00100000:3.0:1788521807.462685:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799070080 00000100:00100000:3.0:1788521807.462782:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:3.0:1788521807.462794:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+15:10438:x1875400799070080:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788521807.463640:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788521807.463779:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1788521807.463837:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c228 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.463857:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c228 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.463871:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c228 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.463892:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c228 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.463898:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c228 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.463904:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c228 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.463928:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788521807.464053:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+17:10438:x1875400799070080:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 1258us (1520us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1788521807.464064:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 20 00000020:00080000:3.0:1788521807.464071:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788521807.464480:0:7631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521807.464489:0:7631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c228 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.464498:0:7631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80030400 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521807.464503:0:7631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c228 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.464513:0:7631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c228 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.464528:0:7631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff996f8687e300) 00010000:00010000:3.0:1788521807.464635:0:7631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788521807.464642:0:7631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c228 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.464661:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c228 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521807.464685:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521807.464688:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521807.464691:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521808.014574:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788521809.018256:0:12052:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788521809.018270:0:12052:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788521809.018323:0:12052:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788521809.018329:0:12052:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788521809.039516:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521809.114708:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521809.114755:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799070336 00000100:00100000:0.0:1788521809.114769:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799070336 00000100:00100000:0.0:1788521809.114843:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 84 00000100:00100000:0.0:1788521809.114853:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadfce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+17:10456:x1875400799070336:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1788521809.114876:0:10083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521809.114895:0:10083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c22f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00a73 expref: -99 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.114985:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001600/0x1b7b50db5927c236 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.115000:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001600/0x1b7b50db5927c236 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.115017:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001600/0x1b7b50db5927c236 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521809.115030:0:10083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788521809.115167:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c22f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a73 expref: 20 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.115182:0:10083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001600/0x1b7b50db5927c236 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a73 expref: 19 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.115190:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:0.0:1788521809.115193:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788521809.115196:0:10083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4001600, rc 0) 00000100:00100000:0.0:1788521809.115249:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadfce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+19:10456:x1875400799070336:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 397us (547us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1788521809.115256:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 84 00000100:00080000:1.0:1788521809.115742:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521809.118919:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521809.120238:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799070464 00000100:00100000:0.0:1788521809.120250:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799070464 00000100:00100000:0.0:1788521809.120311:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 85 00000100:00100000:0.0:1788521809.120323:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadfcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+19:10456:x1875400799070464:12345-192.168.206.48@tcp:34:lfs.0 00010000:00010000:0.0:1788521809.120391:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c244 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.120407:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c244 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.120418:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c244 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.120450:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c24b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.120457:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c24b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.120464:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c24b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.120868:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001c00/0x1b7b50db5927c252 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.120878:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001c00/0x1b7b50db5927c252 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.120886:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001c00/0x1b7b50db5927c252 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788521809.120925:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001c00/0x1b7b50db5927c252 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.120938:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c244 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.120945:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c244 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.120952:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c244 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.120957:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521809.120961:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c244 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.121049:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c244 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.121063:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:0.0:1788521809.121066:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521809.121072:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c244 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.121079:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c244 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.121090:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c24b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.121097:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c24b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.121102:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c24b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.121107:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4001400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521809.121110:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c24b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.121117:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c24b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.121124:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996f83d6d200) 00010000:00010000:0.0:1788521809.121127:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521809.121129:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c24b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.121285:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c24b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.121300:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001c00/0x1b7b50db5927c252 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.121306:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001c00/0x1b7b50db5927c252 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.121312:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001c00/0x1b7b50db5927c252 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.121317:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4001c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521809.121320:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001c00/0x1b7b50db5927c252 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.121326:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001c00/0x1b7b50db5927c252 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.121334:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f83d6d800) 00010000:00010000:0.0:1788521809.121336:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521809.121339:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001c00/0x1b7b50db5927c252 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.121345:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001c00/0x1b7b50db5927c252 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521809.121431:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadfcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+19:10456:x1875400799070464:12345-192.168.206.48@tcp:34:lfs.0 Request processed in 1109us (2793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521809.121439:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 85 00000100:00100000:0.0:1788521809.157834:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521809.157990:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799070720 00000100:00100000:0.0:1788521809.157999:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799070720 00000100:00100000:0.0:1788521809.158047:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 86 00000100:00100000:0.0:1788521809.158056:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+19:10459:x1875400799070720:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1788521809.158074:0:10083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521809.158093:0:10083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c259 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00a7a expref: -99 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.158178:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c260 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.158193:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c260 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.158283:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c260 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.158302:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927c267 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.158309:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927c267 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.158316:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927c267 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.158697:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927c26e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.158707:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927c26e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.158721:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927c26e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521809.158732:0:10083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788521809.158823:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c260 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.158831:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c260 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.158838:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c260 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.158844:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521809.158848:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c260 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.158855:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c260 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.158867:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:0.0:1788521809.158870:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521809.158874:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c260 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.158880:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c260 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.158892:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927c267 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.158897:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927c267 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.158909:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927c267 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.158914:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521809.158917:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927c267 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.158924:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927c267 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.158931:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996f83d6d800) 00010000:00010000:0.0:1788521809.158934:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521809.158937:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927c267 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.158942:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927c267 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.158986:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c259 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a7a expref: 22 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.159000:0:10083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927c26e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a7a expref: 21 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.159007:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f83d6d200) 00010000:00010000:0.0:1788521809.159010:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788521809.159012:0:10083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4001800, rc 0) 00000100:00100000:0.0:1788521809.159073:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+21:10459:x1875400799070720:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 1017us (1248us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1788521809.159090:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 86 00000100:00100000:2.0:1788521809.164657:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521809.164763:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799070848 00000100:00100000:0.0:1788521809.164773:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799070848 00000100:00100000:0.0:1788521809.164852:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 87 00000100:00100000:0.0:1788521809.164861:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+21:10459:x1875400799070848:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:0.0:1788521809.164923:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c27c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.164939:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c27c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.164950:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c27c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.164973:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c27c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.164992:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c27c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.164999:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c27c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.165005:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521809.165010:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c27c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.165018:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c27c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.165028:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f83d6d200) 00010000:00010000:0.0:1788521809.165036:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788521809.165042:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c27c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.165048:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c27c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521809.165116:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+21:10459:x1875400799070848:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 255us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521809.165123:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 87 00000100:00100000:1.0:1788521809.166881:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521809.167517:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799071104 00000100:00100000:2.0:1788521809.167536:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799071104 00000100:00100000:2.0:1788521809.167593:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:2.0:1788521809.167613:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f97fd1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+21:10459:x1875400799071104:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:2.0:1788521809.167981:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f97fd1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+22:10459:x1875400799071104:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 378us (1114us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788521809.167989:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:2.0:1788521809.215875:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521809.216104:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799071360 00000100:00100000:0.0:1788521809.216114:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799071360 00000100:00100000:0.0:1788521809.216219:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 88 00000100:00100000:0.0:1788521809.216232:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+22:9982:x1875400799071360:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:0.0:1788521809.216260:0:10083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521809.216284:0:10083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c283 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00a81 expref: -99 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.216382:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c28a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.216395:0:10083:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927c26e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a7a expref: 23 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.216404:0:10083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c28a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.216434:0:10083:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927c26e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a7a expref: 23 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.216465:0:10083:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927c26e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a7a expref: 23 pid: 10083 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521809.216478:0:10083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad92b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10083:1875400816915968:192.168.206.48@tcp:104: 00000100:00100000:0.0:1788521809.216576:0:10083:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f9e9e93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521809.219231:0:10083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad92b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10083:1875400816915968:192.168.206.48@tcp:104: 00010000:00010000:0.0:1788521809.219264:0:10083:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c28a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521809.222334:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521809.222799:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799071488 00000100:00100000:3.0:1788521809.222809:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799071488 00010000:00010000:2.0:1788521809.222937:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927c26e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a7a expref: 24 pid: 10083 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521809.223030:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 47 00000100:00100000:2.0:1788521809.223041:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+24:2364:x1875400799071488:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521809.223055:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521809.223062:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927c26e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a7a expref: 24 pid: 10083 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.223081:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927c26e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a7a expref: 24 pid: 10083 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.223101:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927c26e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a7a expref: 24 pid: 10083 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.223118:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f83d6d200) 00010000:00010000:2.0:1788521809.223123:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c28a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.223133:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c28a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.223325:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c28a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.223359:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521809.223418:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+23:2364:x1875400799071488:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 378us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521809.223439:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 47 00010000:00010000:0.0:1788521809.223497:0:10083:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c28a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.223506:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c28a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521809.223534:0:10083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788521809.223699:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c283 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a81 expref: 24 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.223714:0:10083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c28a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a81 expref: 23 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.223722:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f83d6d200) 00010000:00010000:0.0:1788521809.223725:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788521809.223727:0:10083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4001400, rc 0) 00000100:00100000:0.0:1788521809.223754:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+23:9982:x1875400799071360:12345-192.168.206.48@tcp:101:bash.0 Request processed in 7525us (7896us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788521809.223766:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 88 00000100:00100000:3.0:1788521809.232241:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb42db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816916480:0@lo:400:kworker.0 00000100:00100000:3.0:1788521809.232307:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521809.232345:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788521809.232353:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb42d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816916096:0@lo:400:kworker.0 00000100:00100000:1.0:1788521809.232392:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521809.232438:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521809.232568:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816916480 00000100:00100000:1.0:1788521809.232576:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816916480 00000100:00100000:3.0:1788521809.232617:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb42d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875400816916608:0@lo:400:kworker.0 00000100:00100000:1.0:1788521809.232647:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788521809.232648:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521809.232662:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb42d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1875400816916480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521809.232682:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb42d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875400816916224:0@lo:400:kworker.0 00000100:00100000:3.0:1788521809.232717:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521809.232725:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb42d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1875400816916480:12345-0@lo:400:kworker.0 Request processed in 66us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521809.232734:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788521809.232742:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb42daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816916736:0@lo:400:kworker.0 00000100:00100000:3.0:1788521809.232782:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521809.232803:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788521809.232809:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb42d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875400816916352:0@lo:400:kworker.0 00000100:00100000:3.0:1788521809.232831:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521809.232836:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816916736 00000100:00100000:1.0:1788521809.232841:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816916736 00000100:00100000:1.0:1788521809.232873:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788521809.232879:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1875400816916736:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788521809.232905:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788521809.232910:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521809.233058:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1875400816916736:12345-0@lo:400:kworker.0 Request processed in 178us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521809.233066:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788521809.233087:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799071744 00000100:00100000:1.0:1788521809.233091:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799071744 00000100:00100000:1.0:1788521809.233108:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816916608 00000100:00100000:1.0:1788521809.233110:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816916608 00000100:00100000:1.0:1788521809.233129:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816916224 00000100:00100000:1.0:1788521809.233131:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816916224 00000100:00100000:1.0:1788521809.233159:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816916352 00000100:00100000:1.0:1788521809.233168:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816916352 00000100:00100000:3.0:1788521809.233239:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816916096 00000100:00100000:3.0:1788521809.233245:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816916096 00000100:00100000:1.0:1788521809.233256:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788521809.233265:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb42dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875400816916608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521809.233280:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788521809.233291:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3304:x1875400816916096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521809.233301:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb42dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875400816916608:12345-0@lo:400:kworker.0 Request processed in 36us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521809.233308:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788521809.233320:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788521809.233327:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb42da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875400816916224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521809.233344:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3304:x1875400816916096:12345-0@lo:400:kworker.0 Request processed in 55us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521809.233353:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788521809.233362:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb42da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875400816916224:12345-0@lo:400:kworker.0 Request processed in 35us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521809.233369:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788521809.233386:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788521809.233393:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875400816916352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521809.233402:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 89 00000100:00100000:3.0:1788521809.233413:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadfcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+23:9982:x1875400799071744:12345-192.168.206.48@tcp:36:bash.0 00000100:00100000:1.0:1788521809.233424:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875400816916352:12345-0@lo:400:kworker.0 Request processed in 31us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521809.233430:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:1.0:1788521809.233499:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788521809.233804:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c298 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.233822:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c298 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.233834:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c298 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521809.233921:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb42daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816916736:0@lo:400:kworker.0 00000100:00100000:0.0:1788521809.233945:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb42d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875400816916352:0@lo:400:kworker.0 00000001:00080000:3.0:1788521809.233957:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000100:00100000:0.0:1788521809.233957:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb42d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875400816916224:0@lo:400:kworker.0 00000004:00010000:3.0:1788521809.234057:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000083a84906 reply state 0000000017570785 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c298 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521809.234065:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788521809.234207:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb42d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816916096:0@lo:400:kworker.0 00000100:00100000:2.0:1788521809.234220:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb42d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875400816916608:0@lo:400:kworker.0 00000100:00100000:2.0:1788521809.234230:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb42db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816916480:0@lo:400:kworker.0 00000001:00080000:3.0:1788521809.234332:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1788521809.234469:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadfcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+27:9982:x1875400799071744:12345-192.168.206.48@tcp:36:bash.0 Request processed in 1057us (2076us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1788521809.234477:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 89 00000020:00080000:3.0:1788521809.234481:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1788521809.238086:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c298 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.238104:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c298 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.238110:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c298 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.238116:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80030400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521809.238120:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c298 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.238128:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c298 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.238172:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f83d6d200) 00010000:00010000:0.0:1788521809.238176:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521809.238182:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c298 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.238189:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c298 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521809.239076:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521809.239370:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799071872 00000100:00100000:2.0:1788521809.239381:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799071872 00000100:00100000:2.0:1788521809.239439:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 90 00000100:00100000:2.0:1788521809.239449:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadfced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+26:9982:x1875400799071872:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:2.0:1788521809.239470:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521809.239490:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c29f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00a88 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.239566:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c29f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a88 expref: 27 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.239580:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c29f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a88 expref: 27 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.239601:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f83d6d200) 00010000:00010000:2.0:1788521809.239604:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788521809.239607:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490b200, rc 0) 00000100:00100000:2.0:1788521809.239664:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadfced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+27:9982:x1875400799071872:12345-192.168.206.48@tcp:101:bash.0 Request processed in 216us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521809.239671:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 90 00000100:00100000:1.0:1788521809.242374:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521809.242600:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799072000 00000100:00100000:2.0:1788521809.242621:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799072000 00000100:00100000:2.0:1788521809.242695:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:2.0:1788521809.242705:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadfcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+6:9982:x1875400799072000:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:2.0:1788521809.242722:0:11097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521809.242745:0:11097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000babcc19f/0x1b7b50db5927c2a6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00a8f expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788521809.242769:0:11097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9aad4e, atime: 0x6a9aad4d, ctime: 0x6a9aad4e, blocks: 0xb 00010000:00010000:2.0:1788521809.242789:0:11097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=309s v=(0 0) 00010000:00010000:2.0:1788521809.242794:0:11097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521809.242801:0:11097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000babcc19f/0x1b7b50db5927c2a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a8f expref: 7 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.242818:0:11097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000babcc19f/0x1b7b50db5927c2a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a8f expref: 7 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.242830:0:11097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490b600, rc 0) 00000100:00100000:2.0:1788521809.242883:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadfcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+7:9982:x1875400799072000:12345-192.168.206.48@tcp:101:bash.0 Request processed in 178us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521809.242890:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00080000:1.0:1788521809.243587:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521809.245405:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521809.245478:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799072128 00000100:00100000:3.0:1788521809.245486:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799072128 00002000:00010000:3.0:1788521809.245533:0:6693:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1788521809.245537:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff996fbc3ed500 with x1875400799072128 ext(0->18446744073709551615) 00002000:00010000:3.0:1788521809.245547:0:6693:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996fbc3ed500. 00000100:00100000:3.0:1788521809.245600:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:3.0:1788521809.245609:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2364:x1875400799072128:12345-192.168.206.48@tcp:10:bash.0 00002000:00010000:3.0:1788521809.245873:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788521809.245877:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788521806 -> 1788521809 00002000:00010000:3.0:1788521809.245880:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788521805 -> 1788521805 00002000:00010000:3.0:1788521809.245882:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788521806 -> 1788521809 00002000:00010000:3.0:1788521809.245885:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788521809.245997:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+8:2364:x1875400799072128:12345-192.168.206.48@tcp:10:bash.0 Request processed in 387us (598us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788521809.246005:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 1 00002000:00010000:3.0:1788521809.246008:0:6693:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1788521809.246011:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff996fbc3ed500 with x1875400799072128 ext(0->18446744073709551615) 00002000:00010000:3.0:1788521809.246015:0:6693:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996fbc3ed500. 00000100:00100000:0.0:1788521809.335376:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521809.335499:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799072256 00000100:00100000:2.0:1788521809.335509:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799072256 00000100:00100000:2.0:1788521809.335674:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 91 00000100:00100000:2.0:1788521809.335685:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad92b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+27:10473:x1875400799072256:12345-192.168.206.48@tcp:34:lfs.0 00010000:00010000:2.0:1788521809.335752:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c2ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.335786:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c2ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.335808:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c2ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.335825:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c2b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.335833:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c2b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.335839:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c2b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.336062:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c2bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.336071:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c2bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.336079:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c2bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788521809.336116:0:10083:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c2bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.336126:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c2ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.336132:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c2ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.336175:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c2ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.336180:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490a200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521809.336184:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c2ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.336191:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c2ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.336202:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:2.0:1788521809.336205:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521809.336209:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c2ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.336215:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c2ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.336225:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c2b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.336231:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c2b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.336236:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c2b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.336242:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490ae00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521809.336244:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c2b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.336260:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c2b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.336269:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996fb19ef400) 00010000:00010000:2.0:1788521809.336271:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521809.336275:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c2b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.336281:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c2b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.336294:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c2bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.336300:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c2bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.336305:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c2bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.336310:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490aa00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521809.336312:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c2bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.336318:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c2bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.336325:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f83d6d200) 00010000:00010000:2.0:1788521809.336327:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521809.336330:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c2bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.336346:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c2bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521809.336425:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad92b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+27:10473:x1875400799072256:12345-192.168.206.48@tcp:34:lfs.0 Request processed in 740us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521809.336433:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 91 00000100:00100000:1.0:1788521809.415215:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521809.415489:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799072512 00000100:00100000:2.0:1788521809.415499:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799072512 00000100:00100000:2.0:1788521809.415632:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 92 00000100:00100000:2.0:1788521809.415643:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadfcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+27:10476:x1875400799072512:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521809.415663:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521809.415681:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c2c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00a96 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.415746:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c2c9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.415760:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c2c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.415771:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c2c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.415785:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c2d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.415791:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c2d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.415815:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c2d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.416402:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c2d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.416414:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.416422:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521809.416432:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788521809.416519:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c2c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.416539:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c2c9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.416546:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c2c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.417262:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490ae00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521809.417269:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c2c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.417278:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c2c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.417293:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:2.0:1788521809.417296:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521809.417312:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c2c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.417319:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c2c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.417334:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c2d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.417340:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c2d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.417346:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c2d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.417351:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490a200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521809.417354:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c2d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.417360:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c2d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.417367:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996fb19ef400) 00010000:00010000:2.0:1788521809.417370:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521809.417373:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c2d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.417379:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c2d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.417430:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c2c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a96 expref: 30 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.417457:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c2d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a96 expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.417465:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f83d6d200) 00010000:00010000:2.0:1788521809.417467:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788521809.417470:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490ac00, rc 0) 00000100:00100000:2.0:1788521809.417557:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadfcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+29:10476:x1875400799072512:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 1907us (2495us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1788521809.417566:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 92 00000100:00100000:0.0:1788521809.422613:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521809.422700:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799072640 00000100:00100000:3.0:1788521809.422712:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799072640 00000100:00100000:3.0:1788521809.422769:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 93 00000100:00100000:3.0:1788521809.422780:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad92b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+29:10476:x1875400799072640:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:3.0:1788521809.422858:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c2e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.422874:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c28a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a81 expref: 29 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.422883:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c2e5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.422913:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c28a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a81 expref: 29 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.423363:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c28a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a81 expref: 29 pid: 10083 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521809.423380:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1875400816916864:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788521809.423471:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb18faa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521809.428858:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521809.428957:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1875400816916864:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788521809.428984:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c2e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521809.429389:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799072896 00000100:00100000:1.0:1788521809.429396:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799072896 00000100:00100000:1.0:1788521809.429451:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:1.0:1788521809.429460:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+30:5597:x1875400799072896:12345-192.168.206.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788521809.429767:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+31:5597:x1875400799072896:12345-192.168.206.48@tcp:35:ldlm_bl.0 Request processed in 307us (920us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1788521809.429787:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:1.0:1788521809.434308:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521809.434419:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799073024 00000100:00100000:3.0:1788521809.434429:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799073024 00010000:00010000:3.0:1788521809.434469:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c28a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a81 expref: 31 pid: 10083 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521809.434512:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 48 00000100:00100000:3.0:1788521809.434533:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadfcf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+31:2363:x1875400799073024:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521809.434549:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521809.434605:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c28a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a81 expref: 31 pid: 10083 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.434625:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c28a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a81 expref: 31 pid: 10083 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.434645:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c28a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a81 expref: 31 pid: 10083 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.434678:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f83d6d200) 00010000:00010000:3.0:1788521809.434684:0:7633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c2e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.434693:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.434701:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c2e5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.434787:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521809.434842:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadfcf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+30:2363:x1875400799073024:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 321us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521809.434849:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 48 00010000:00010000:2.0:1788521809.435467:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.435477:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.435508:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.435515:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c2e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.435521:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c2e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.435539:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80031400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521809.435543:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c2e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.435551:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c2e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.435575:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f83d6d200) 00010000:00010000:2.0:1788521809.435578:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521809.435582:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c2e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.435589:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c2e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521809.435697:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad92b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+29:10476:x1875400799072640:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 12918us (13093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521809.435707:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 93 00000100:00100000:1.0:1788521809.442025:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521809.442353:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799073280 00000100:00100000:0.0:1788521809.442368:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799073280 00000100:00100000:0.0:1788521809.442503:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:0.0:1788521809.442517:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadfcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+29:10476:x1875400799073280:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:0.0:1788521809.442907:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadfcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+30:10476:x1875400799073280:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 392us (896us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1788521809.442916:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:0.0:1788521809.555637:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521809.555765:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799073536 00000100:00100000:1.0:1788521809.555778:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799073536 00000100:00100000:1.0:1788521809.555853:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 94 00000100:00100000:1.0:1788521809.555864:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+30:10486:x1875400799073536:12345-192.168.206.48@tcp:101:cat.0 00010000:00010000:1.0:1788521809.555892:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521809.555920:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927c2ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00a9d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.556016:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c2f3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.556034:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c2f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.556048:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c2f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.556064:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927c2fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.556072:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927c2fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.556090:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927c2fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.556489:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c301 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.556508:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c301 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.556516:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c301 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521809.556541:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1788521809.556657:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c2f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.556664:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c2f3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.556671:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c2f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.556677:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521809.556682:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c2f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.556690:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c2f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.556704:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:1.0:1788521809.556707:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521809.556712:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c2f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.556718:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c2f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.556734:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927c2fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.556746:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927c2fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.556752:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927c2fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.556757:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521809.556760:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927c2fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.556767:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927c2fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.556775:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996fa0d5cc00) 00010000:00010000:1.0:1788521809.556778:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521809.556780:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927c2fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.556787:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927c2fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.556842:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927c2ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a9d expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.556857:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c301 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a9d expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.556866:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f83d6d200) 00010000:00010000:1.0:1788521809.556868:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521809.556877:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d4400, rc 0) 00000100:00100000:1.0:1788521809.556973:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+32:10486:x1875400799073536:12345-192.168.206.48@tcp:101:cat.0 Request processed in 1109us (1348us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788521809.556982:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 94 00000100:00100000:1.0:1788521809.561013:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521809.561127:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799073792 00000100:00100000:2.0:1788521809.561179:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799073792 00000100:00100000:2.0:1788521809.561246:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 24 00000100:00100000:2.0:1788521809.561258:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadfcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+32:10486:x1875400799073792:12345-192.168.206.48@tcp:35:cat.0 00000100:00100000:2.0:1788521809.561708:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadfcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+33:10486:x1875400799073792:12345-192.168.206.48@tcp:35:cat.0 Request processed in 451us (707us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788521809.561717:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 24 00000100:00100000:3.0:1788521809.583844:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521809.585714:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799074048 00000100:00100000:2.0:1788521809.585734:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799074048 00000100:00100000:2.0:1788521809.585828:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 95 00000100:00100000:2.0:1788521809.585840:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+33:10488:x1875400799074048:12345-192.168.206.48@tcp:36:rm.0 00010000:00010000:2.0:1788521809.585917:0:10083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788521809.585951:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c301 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a9d expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.586418:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c2d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a96 expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.586464:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c29f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a88 expref: 31 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.586476:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996f83d6d200) 00010000:00010000:2.0:1788521809.586489:0:10083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521809.586535:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c30f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.588235:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c30f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.588262:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c30f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.588295:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c316 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.588307:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c316 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.588313:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c316 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.588778:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c31d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.588789:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c31d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.588797:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c31d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788521809.591242:0:10083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1788521809.591261:0:10083:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 309576117450ns, next at 310576113265ns, rc = 0 00010000:00010000:2.0:1788521809.591368:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c324 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.591392:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c324 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.591406:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c324 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.591416:0:10083:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c324 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.591423:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c324 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.591431:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c324 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.591461:0:10083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521809.591491:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c31d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.591498:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c31d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.591504:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c31d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.591510:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490ae00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521809.591534:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c31d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.592675:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c31d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.592696:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996fb19ef900) 00010000:00010000:2.0:1788521809.592700:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788521809.592707:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c31d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.592715:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c31d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.592722:0:7631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521809.592733:0:7631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c324 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.592742:0:7631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490bc00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521809.592747:0:7631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c324 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.592748:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c30f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.592765:0:7631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c324 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.592766:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c30f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.592783:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c30f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.592788:0:7631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996fb19ef900) 00010000:00010000:2.0:1788521809.592790:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490aa00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521809.592795:0:7631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788521809.592796:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c30f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.592801:0:7631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c324 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.592806:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c30f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.592816:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:2.0:1788521809.592821:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521809.592828:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c324 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.592835:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c30f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.592854:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521809.592857:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521809.592859:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521809.593253:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c30f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788521809.593271:0:10083:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a350b47f reply state 0000000027d807d0 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c316 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521809.593282:0:10083:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788521809.593720:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+32:10488:x1875400799074048:12345-192.168.206.48@tcp:36:rm.0 Request processed in 7875us (9883us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788521809.593731:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 95 00010000:00010000:2.0:1788521809.599085:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c316 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.599107:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c316 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.599117:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c316 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.599124:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490a200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521809.599129:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c316 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.599138:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c316 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.599216:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996fb19ef400) 00010000:00010000:2.0:1788521809.599220:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521809.599226:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c316 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.599253:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c316 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521809.644183:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521809.645091:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799074304 00000100:00100000:1.0:1788521809.645106:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799074304 00000100:00100000:1.0:1788521809.645243:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 96 00000100:00100000:1.0:1788521809.645255:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+31:10494:x1875400799074304:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:1.0:1788521809.645287:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521809.645314:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927c32b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00aa4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.645470:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c332 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.645489:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c332 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.645504:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c332 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.645972:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927c339 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.645984:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927c339 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.645993:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927c339 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788521809.646851:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788521809.647048:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c340 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.647062:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c340 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.647072:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c340 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.647116:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c332 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.647122:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c332 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.647127:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c332 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.647131:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521809.647135:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c332 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.647178:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c332 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.647193:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:1.0:1788521809.647196:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521809.647201:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c332 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.647219:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c332 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788521809.647238:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000830c9df4 reply state 00000000db99f1b6 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927c339 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521809.647248:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788521809.647288:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927c32b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00aa4 expref: 34 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.647303:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c340 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00aa4 expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.647311:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c500) 00010000:00010000:1.0:1788521809.647314:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521809.647316:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d4400, rc 0) 00000100:00100000:1.0:1788521809.647509:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+34:10494:x1875400799074304:12345-192.168.206.48@tcp:101:bash.0 Request processed in 2254us (3375us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1788521809.647650:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 96 00010000:00010000:0.0:1788521809.649759:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927c339 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.649780:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927c339 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.649788:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927c339 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.649795:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521809.649801:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927c339 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.649810:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927c339 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.649832:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996fa0d5cc00) 00010000:00010000:0.0:1788521809.649853:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521809.649860:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927c339 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.649868:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927c339 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521809.653441:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521809.653508:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799074432 00000100:00100000:1.0:1788521809.653520:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799074432 00000100:00100000:1.0:1788521809.653626:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 34 00000100:00100000:1.0:1788521809.653637:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2361:x1875400799074432:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:1.0:1788521809.653660:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521809.653686:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b64f319/0x1b7b50db5927c34e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00aab expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788521809.653742:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521809.653770:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=309s v=(0 0) 00010000:00010000:1.0:1788521809.653775:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521809.653786:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b64f319/0x1b7b50db5927c34e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00aab expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.653809:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003b64f319/0x1b7b50db5927c34e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00aab expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.653823:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d4200, rc 0) 00000100:00100000:1.0:1788521809.653893:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+8:2361:x1875400799074432:12345-192.168.206.48@tcp:101:bash.0 Request processed in 258us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521809.653900:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 34 00000100:00080000:0.0:1788521809.654682:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788521809.658174:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521809.658304:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799074560 00000100:00100000:2.0:1788521809.658316:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799074560 00000100:00100000:2.0:1788521809.658413:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 35 00000100:00100000:2.0:1788521809.658426:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+8:10494:x1875400799074560:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:2.0:1788521809.658450:0:11097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521809.658474:0:11097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c355 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00ab2 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.658533:0:11097:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003b64f319/0x1b7b50db5927c34e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00aab expref: 9 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.658543:0:11097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521809.658654:0:11097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521809.658663:0:11097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c355 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ab2 expref: 9 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.658708:0:11097:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003b64f319/0x1b7b50db5927c34e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00aab expref: 9 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.658732:0:11097:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003b64f319/0x1b7b50db5927c34e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00aab expref: 9 pid: 6690 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521809.658748:0:11097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc3eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11097:1875400816916992:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788521809.659613:0:11097:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb4905840 going to sleep for 11 seconds 00000100:00100000:2.0:1788521809.663255:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521809.663332:0:11097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc3eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11097:1875400816916992:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788521809.663385:0:11097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c355 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ab2 expref: 9 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.663411:0:11097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490aa00, rc 0) 00000100:00100000:1.0:1788521809.663488:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+9:10494:x1875400799074560:12345-192.168.206.48@tcp:101:bash.0 Request processed in 5064us (5358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521809.663497:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 35 00000100:00100000:3.0:1788521809.663546:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799074688 00000100:00100000:3.0:1788521809.663564:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799074688 00010000:00010000:3.0:1788521809.663607:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003b64f319/0x1b7b50db5927c34e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00aab expref: 9 pid: 6690 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521809.663654:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 49 00000100:00100000:3.0:1788521809.663665:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f856e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+9:2363:x1875400799074688:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521809.663681:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521809.663709:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003b64f319/0x1b7b50db5927c34e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00aab expref: 9 pid: 6690 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.663735:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003b64f319/0x1b7b50db5927c34e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00aab expref: 9 pid: 6690 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.663769:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b64f319/0x1b7b50db5927c34e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00aab expref: 9 pid: 6690 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.663810:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521809.663815:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521809.663824:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c355 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ab2 expref: 8 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.663837:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c355 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ab2 expref: 8 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.663880:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c355 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ab2 expref: 8 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521809.663984:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a7fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5819:1875400816917120:192.168.206.48@tcp:105: 00000100:00100000:3.0:1788521809.664122:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb18faa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521809.670900:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a7fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5819:1875400816917120:192.168.206.48@tcp:105: 00010000:00010000:3.0:1788521809.670964:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521809.671444:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f856e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+8:2363:x1875400799074688:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 7778us (8202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521809.671458:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 49 00000100:00100000:0.0:1788521809.672735:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521809.672912:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799074944 00000100:00100000:1.0:1788521809.672924:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799074944 00000100:00100000:1.0:1788521809.673124:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 25 00000100:00100000:1.0:1788521809.673173:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad92a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+33:10494:x1875400799074944:12345-192.168.206.48@tcp:35:bash.0 00000100:00100000:1.0:1788521809.673687:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad92a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+34:10494:x1875400799074944:12345-192.168.206.48@tcp:35:bash.0 Request processed in 516us (959us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1788521809.673696:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 25 00000100:00100000:0.0:1788521809.742660:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816917248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521809.742761:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521809.742880:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816917248 00000100:00100000:0.0:1788521809.742890:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816917248 00000100:00100000:0.0:1788521809.742958:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788521809.742969:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875400816917248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788521809.743019:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521809.743085:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875400816917248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521809.743093:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788521809.743353:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816917248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521809.784831:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521809.789735:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799075072 00000100:00100000:3.0:1788521809.789757:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799075072 00000100:00100000:3.0:1788521809.790088:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 97 00000100:00100000:3.0:1788521809.790103:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadfcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+34:10510:x1875400799075072:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521809.790673:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521809.790704:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c35c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00ab9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.790788:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c363 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.790806:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c363 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.790884:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c363 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521809.790932:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788521809.790936:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788521809.790958:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c363 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.790996:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c35c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ab9 expref: 36 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.791019:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c363 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ab9 expref: 35 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.791029:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:3.0:1788521809.791032:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788521809.791036:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f80031400, rc 0) 00000100:00100000:3.0:1788521809.791401:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadfcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+35:10510:x1875400799075072:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 1300us (6582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521809.791411:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 97 00000100:00100000:0.0:1788521809.798108:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521809.798407:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799075328 00000100:00100000:2.0:1788521809.798420:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799075328 00000100:00100000:1.0:1788521809.798586:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 98 00000100:00100000:1.0:1788521809.798601:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+35:10510:x1875400799075328:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1788521809.798633:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521809.798661:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927c36a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00ac0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.798827:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c371 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.798844:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c371 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.798858:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c371 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521809.798871:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788521809.799843:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927c36a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ac0 expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.799870:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c371 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ac0 expref: 37 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.799881:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c500) 00010000:00010000:1.0:1788521809.799898:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521809.799903:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d5200, rc 0) 00000100:00100000:1.0:1788521809.800097:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+37:10510:x1875400799075328:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 1498us (2000us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788521809.800106:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 98 00000100:00100000:0.0:1788521809.835270:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521809.835340:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521809.835659:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799075712 00000100:00100000:1.0:1788521809.835672:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799075712 00000100:00100000:1.0:1788521809.835747:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 99 00000100:00100000:1.0:1788521809.835758:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad92b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+37:10510:x1875400799075712:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1788521809.835788:0:10083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521809.835814:0:10083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927c37f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00ac7 expref: -99 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.835939:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c386 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.835957:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c386 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.835972:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c386 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521809.835986:0:10083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788521809.836184:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927c37f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ac7 expref: 40 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.836209:0:10083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c386 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ac7 expref: 39 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.836242:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c500) 00010000:00010000:1.0:1788521809.836245:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788521809.836250:0:10083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d5c00, rc 0) 00000100:00100000:1.0:1788521809.836336:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad92b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+39:10510:x1875400799075712:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 580us (995us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1788521809.836345:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 99 00000100:00100000:2.0:1788521809.837216:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799075456 00000100:00100000:2.0:1788521809.837228:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799075456 00000100:00100000:2.0:1788521809.837286:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:2.0:1788521809.837297:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad928380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+39:2363:x1875400799075456:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521809.837312:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521809.837348:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c371 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ac0 expref: 39 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.837369:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c500) 00010000:00010000:2.0:1788521809.837373:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521809.837432:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad928380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+38:2363:x1875400799075456:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 137us (2178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521809.837440:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:0.0:1788521809.841799:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521809.841896:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799075840 00000100:00100000:1.0:1788521809.841912:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799075840 00000100:00100000:1.0:1788521809.841985:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:1.0:1788521809.841998:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+8:2364:x1875400799075840:12345-192.168.206.48@tcp:1:lfs.0 00010000:00010000:1.0:1788521809.842064:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df46bef0/0x1b7b50db5927c394 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.842090:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c355 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ab2 expref: 8 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.842100:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521809.842104:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788521809.842109:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df46bef0/0x1b7b50db5927c394 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.842920:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c355 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ab2 expref: 8 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.842955:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c355 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ab2 expref: 8 pid: 11097 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521809.843008:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fadfce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1875400816917376:192.168.206.48@tcp:104: 00000100:00100000:1.0:1788521809.843133:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f91285840 going to sleep for 11 seconds 00000100:00100000:1.0:1788521809.846958:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fadfce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1875400816917376:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788521809.847001:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000df46bef0/0x1b7b50db5927c394 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521809.848403:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521809.848678:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799075968 00000100:00100000:2.0:1788521809.848690:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799075968 00002000:00100000:2.0:1788521809.848759:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff996fad929180 x1875400799075968/t0(0) o4->4bd13e8f-aac9-42ad-8625-a542705d6920@192.168.206.48@tcp:55/0 lens 504/0 e 0 to 0 dl 1788521820 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788521809.848771:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff996fad929180 with x1875400799075968 ext(0->8) 00010000:00010000:2.0:1788521809.848782:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c355 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ab2 expref: 9 pid: 11097 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.848809:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c355 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ab2 expref: 9 pid: 11097 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788521809.848844:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff996fad929180 00000100:00100000:2.0:1788521809.852133:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:2.0:1788521809.852190:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad929180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+9:2363:x1875400799075968:12345-192.168.206.48@tcp:4:lfs.0 00000100:00100000:2.0:1788521809.852824:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad929180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+11:2363:x1875400799075968:12345-192.168.206.48@tcp:4:lfs.0 Request processed in 650us (4428us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788521809.852835:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 1 00002000:00100000:2.0:1788521809.852847:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff996fad929180 x1875400799075968/t4294967302(0) o4->4bd13e8f-aac9-42ad-8625-a542705d6920@192.168.206.48@tcp:55/0 lens 504/448 e 0 to 0 dl 1788521820 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788521809.852858:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff996fad929180 with x1875400799075968 ext(0->8) 00010000:00010000:2.0:1788521809.852871:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c355 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ab2 expref: 11 pid: 11097 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.852903:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c355 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ab2 expref: 11 pid: 11097 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788521809.852913:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff996fad929180 00000100:00100000:3.0:1788521809.859881:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521809.860880:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799076096 00000100:00100000:2.0:1788521809.860895:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799076096 00010000:00010000:2.0:1788521809.860951:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c355 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ab2 expref: 11 pid: 11097 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521809.861009:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 50 00000100:00100000:2.0:1788521809.861020:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+11:2362:x1875400799076096:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521809.861056:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788521809.861081:0:7633:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788521809.861084:0:7633:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788521810 00002000:00010000:2.0:1788521809.861086:0:7633:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788521810 00002000:00010000:2.0:1788521809.861088:0:7633:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788521810 00010000:00010000:2.0:1788521809.861439:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c355 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ab2 expref: 11 pid: 11097 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.861466:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c355 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ab2 expref: 11 pid: 11097 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.861496:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c355 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ab2 expref: 11 pid: 11097 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.861517:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788521809.861531:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788521809.861538:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000df46bef0/0x1b7b50db5927c394 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.861549:0:7633:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df46bef0/0x1b7b50db5927c394 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521809.862063:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521809.862547:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+10:2362:x1875400799076096:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 1522us (2672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521809.862558:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 50 00010000:00010000:1.0:1788521809.864671:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000df46bef0/0x1b7b50db5927c394 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.864697:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df46bef0/0x1b7b50db5927c394 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.864745:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df46bef0/0x1b7b50db5927c394 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.864755:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df46bef0/0x1b7b50db5927c394 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.864764:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df46bef0/0x1b7b50db5927c394 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.864771:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5800 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:1.0:1788521809.864777:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df46bef0/0x1b7b50db5927c394 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.864809:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df46bef0/0x1b7b50db5927c394 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.864907:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df46bef0/0x1b7b50db5927c394 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.864918:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df46bef0/0x1b7b50db5927c394 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521809.865057:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+9:2364:x1875400799075840:12345-192.168.206.48@tcp:1:lfs.0 Request processed in 23056us (23266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521809.865070:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:2.0:1788521809.869014:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521809.869380:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799076352 00000100:00100000:0.0:1788521809.869600:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799076352 00000100:00100000:0.0:1788521809.869674:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 26 00000100:00100000:0.0:1788521809.869686:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f97fd2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+38:10510:x1875400799076352:12345-192.168.206.48@tcp:35:lfs.0 00000004:00010000:0.0:1788521809.869792:0:5837:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c386 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ac7 expref: 38 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788521809.870986:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1788521809.871035:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1788521809.871789:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1788521809.871874:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c39b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.871899:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c340 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00aa4 expref: 42 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.871909:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c39b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.871957:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c340 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00aa4 expref: 42 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.871985:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c340 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00aa4 expref: 42 pid: 5834 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521809.872002:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad928a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1875400816917504:192.168.206.48@tcp:104: 00000100:00100000:0.0:1788521809.872132:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f9e9e93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521809.876655:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad928a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1875400816917504:192.168.206.48@tcp:104: 00010000:00010000:0.0:1788521809.876699:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c39b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521809.884207:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521809.884681:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799076480 00000100:00100000:3.0:1788521809.884695:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799076480 00010000:00010000:3.0:1788521809.884756:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c340 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00aa4 expref: 43 pid: 5834 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521809.884807:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 51 00000100:00100000:3.0:1788521809.884819:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+43:2364:x1875400799076480:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521809.884838:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521809.884846:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c340 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00aa4 expref: 43 pid: 5834 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.884872:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c340 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00aa4 expref: 43 pid: 5834 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.884899:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c340 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00aa4 expref: 43 pid: 5834 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.884922:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c500) 00010000:00010000:3.0:1788521809.884928:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c39b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.884940:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c39b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.884949:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c39b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.884998:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788521809.885545:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c39b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521809.885568:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c39b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788521809.885745:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1788521809.886021:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1788521809.886203:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+44:2364:x1875400799076480:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 1381us (2007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521809.886216:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 51 00000100:00100000:0.0:1788521809.887238:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad928a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1875400816917632:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788521809.887551:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521809.887658:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f85c9d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521809.887726:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816917632 00000100:00100000:1.0:1788521809.887736:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816917632 00000100:00100000:1.0:1788521809.887846:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788521809.887858:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad92ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5837:x1875400816917632:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788521809.887976:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad92ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5837:x1875400816917632:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 120us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521809.887984:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788521809.888068:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad928a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1875400816917632:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788521809.888781:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1788521809.888882:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a7dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1875400816917760:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788521809.888938:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521809.890193:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f9e9e93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521809.890713:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816917760 00000100:00100000:0.0:1788521809.890725:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816917760 00000100:00100000:0.0:1788521809.890791:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788521809.890802:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:5837:x1875400816917760:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788521809.891212:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:5837:x1875400816917760:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 411us (2272us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788521809.891220:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788521809.891656:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a7dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1875400816917760:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788521809.891747:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1788521809.891811:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c39b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.891884:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c39b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.891893:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c39b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.891900:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521809.891906:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c39b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.891916:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c39b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.891936:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c500) 00010000:00010000:3.0:1788521809.891939:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788521809.891946:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c39b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521809.891972:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c39b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788521809.894394:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788521809.894861:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1788521809.894878:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 309879734739ns, next at 310879730267ns, rc = 0 00000001:00080000:3.0:1788521809.894892:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1788521809.895055:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c500) 00010000:00010000:3.0:1788521809.895060:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788521809.895076:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c386 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ac7 expref: 46 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521809.895541:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f97fd2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+45:10510:x1875400799076352:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 25854us (26538us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1788521809.895562:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 26 00000020:00080000:3.0:1788521809.895569:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788521809.902972:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521809.903110:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799076608 00000100:00100000:1.0:1788521809.903124:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799076608 00000100:00100000:1.0:1788521809.903455:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 100 00000100:00100000:1.0:1788521809.903469:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+45:10510:x1875400799076608:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1788521809.903501:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521809.903722:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927c3a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00ace expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.903902:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927c3a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ace expref: 46 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.903921:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927c3a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ace expref: 46 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.903945:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:1.0:1788521809.903948:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788521809.903953:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d4600, rc 0) 00000100:00100000:1.0:1788521809.904111:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+46:10510:x1875400799076608:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 644us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521809.904119:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 100 00000100:00100000:2.0:1788521809.910094:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521809.910489:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799076864 00000100:00100000:1.0:1788521809.910502:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799076864 00000100:00100000:1.0:1788521809.910708:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:1.0:1788521809.910721:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+46:10510:x1875400799076864:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:1.0:1788521809.912340:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+47:10510:x1875400799076864:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 1607us (2449us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1788521809.912354:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:3.0:1788521809.997469:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521809.997577:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799076992 00000100:00100000:1.0:1788521809.997596:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799076992 00000100:00100000:1.0:1788521809.997651:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 101 00000100:00100000:1.0:1788521809.997661:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+47:10520:x1875400799076992:12345-192.168.206.48@tcp:34:lfs.0 00010000:00010000:1.0:1788521809.997753:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c3a9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.997799:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c3a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.997811:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c3a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.997828:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c3b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.997835:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c3b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.997841:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c3b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.997926:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c3b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.997936:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c3b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.997942:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c3b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788521809.997980:0:10083:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c3b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.997991:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c3a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.997998:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c3a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.998017:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c3a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.998022:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d4a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521809.998027:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c3a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.998325:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c3a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.998337:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:1.0:1788521809.998340:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521809.998346:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c3a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.998352:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c3a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.998366:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c3b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.998373:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c3b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.998379:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c3b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.998386:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521809.998389:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c3b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.998409:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c3b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.998419:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996fa0d5c900) 00010000:00010000:1.0:1788521809.998421:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521809.998424:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c3b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.998430:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c3b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.998447:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c3b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.998454:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c3b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.998460:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c3b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.998465:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d4000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521809.998468:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c3b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.998475:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c3b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.998482:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:1.0:1788521809.998484:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521809.998487:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c3b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521809.998502:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c3b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521809.998882:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+47:10520:x1875400799076992:12345-192.168.206.48@tcp:34:lfs.0 Request processed in 1210us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521809.998896:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 101 00000100:00100000:2.0:1788521810.060795:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521810.060932:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799077248 00000100:00100000:0.0:1788521810.060945:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799077248 00000100:00100000:0.0:1788521810.061029:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 102 00000100:00100000:0.0:1788521810.061042:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+47:10523:x1875400799077248:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1788521810.061068:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521810.061095:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001200/0x1b7b50db5927c3be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00ad5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.061244:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000e00/0x1b7b50db5927c3c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.061263:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000e00/0x1b7b50db5927c3c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.061280:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000e00/0x1b7b50db5927c3c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.061297:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c3cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.061305:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c3cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.061313:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c3cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.061454:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c3d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.061464:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c3d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.061472:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c3d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521810.061483:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788521810.061621:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000e00/0x1b7b50db5927c3c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.061630:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000e00/0x1b7b50db5927c3c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.061645:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000e00/0x1b7b50db5927c3c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.061652:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521810.061658:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000e00/0x1b7b50db5927c3c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.061668:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000e00/0x1b7b50db5927c3c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.061682:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:0.0:1788521810.061686:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521810.061692:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000e00/0x1b7b50db5927c3c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.061700:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000e00/0x1b7b50db5927c3c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.061716:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c3cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.061722:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c3cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.061728:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c3cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.061734:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4001400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521810.061737:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c3cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.061753:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c3cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.061762:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996f83d6d800) 00010000:00010000:0.0:1788521810.061764:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521810.061767:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c3cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.061772:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c3cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.061821:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001200/0x1b7b50db5927c3be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ad5 expref: 50 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.061836:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c3d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ad5 expref: 49 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.061843:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:0.0:1788521810.061845:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788521810.061847:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4001000, rc 0) 00000100:00100000:0.0:1788521810.061930:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+49:10523:x1875400799077248:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 890us (1148us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1788521810.061939:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 102 00010000:00010000:2.0:1788521810.064675:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521810.066600:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521810.066714:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799077376 00000100:00100000:3.0:1788521810.066726:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799077376 00000100:00100000:3.0:1788521810.066930:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 103 00000100:00100000:3.0:1788521810.066944:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+49:10523:x1875400799077376:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:3.0:1788521810.067105:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c3e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.067127:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c3e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.067175:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c3e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.067222:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c3e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.067231:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c3e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.067239:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c3e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.067246:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80031a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521810.067251:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c3e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.067260:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c3e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.067275:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:3.0:1788521810.067279:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788521810.067284:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c3e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.067292:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c3e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521810.067433:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+49:10523:x1875400799077376:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 491us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521810.067441:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 103 00000100:00100000:3.0:1788521810.074417:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521810.074944:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799077632 00000100:00100000:0.0:1788521810.074968:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799077632 00000100:00100000:0.0:1788521810.075560:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 28 00000100:00100000:0.0:1788521810.075573:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+49:10523:x1875400799077632:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:0.0:1788521810.075911:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+50:10523:x1875400799077632:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 340us (1506us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1788521810.075920:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 28 00000100:00100000:2.0:1788521810.169827:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521810.169943:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799077888 00000100:00100000:0.0:1788521810.169957:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799077888 00000100:00100000:0.0:1788521810.170342:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 104 00000100:00100000:0.0:1788521810.170356:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb78a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+50:10533:x1875400799077888:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:0.0:1788521810.170501:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521810.170506:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788521810.170560:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c363 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ab9 expref: 50 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.170710:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:0.0:1788521810.170723:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788521810.170744:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001200/0x1b7b50db5927c3e8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00adc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.171012:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c3ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.171029:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c3d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ad5 expref: 50 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.171038:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c3ef lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.171338:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c3d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ad5 expref: 50 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.171512:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c3d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ad5 expref: 50 pid: 5834 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521810.171551:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad929500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875400816917888:192.168.206.48@tcp:104: 00000100:00100000:0.0:1788521810.171866:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb47d33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521810.184418:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521810.184492:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799078016 00000100:00100000:1.0:1788521810.184505:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799078016 00010000:00010000:1.0:1788521810.184577:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c3d3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ad5 expref: 51 pid: 5834 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521810.184635:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 52 00000100:00100000:1.0:1788521810.184648:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb78a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+51:2364:x1875400799078016:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521810.184669:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521810.184677:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c3d3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ad5 expref: 51 pid: 5834 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.184705:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c3d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ad5 expref: 51 pid: 5834 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.184734:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:1.0:1788521810.184740:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c3ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.184753:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c3ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.184762:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c3ef lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.184788:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521810.184884:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb78a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+51:2364:x1875400799078016:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 238us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521810.184893:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 52 00010000:00010000:0.0:1788521810.185836:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c3d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ad5 expref: 50 pid: 5834 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521810.185862:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad929500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875400816917888:192.168.206.48@tcp:104: 00010000:00010000:0.0:1788521810.185893:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c3ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.185904:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c3ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.185911:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c3ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521810.185934:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788521810.186290:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001200/0x1b7b50db5927c3e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00adc expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.186307:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c3ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00adc expref: 50 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.186317:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:0.0:1788521810.186332:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788521810.186336:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4001400, rc 0) 00000100:00100000:0.0:1788521810.186404:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb78a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+50:10533:x1875400799077888:12345-192.168.206.48@tcp:101:bash.0 Request processed in 16052us (17039us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788521810.186413:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 104 00000100:00100000:0.0:1788521810.189083:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521810.189198:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799078272 00000100:00100000:1.0:1788521810.189210:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799078272 00000100:00100000:1.0:1788521810.189284:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 105 00000100:00100000:1.0:1788521810.189297:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+50:10533:x1875400799078272:12345-192.168.206.48@tcp:36:bash.0 00010000:00010000:1.0:1788521810.190243:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c3fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.190267:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c3fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.190282:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c3fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788521810.191814:0:10083:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1788521810.191888:0:10083:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000368f31e2 reply state 000000002171d1b1 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c3fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521810.191903:0:10083:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788521810.192073:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+53:10533:x1875400799078272:12345-192.168.206.48@tcp:36:bash.0 Request processed in 2771us (2997us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1788521810.192083:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 105 00000020:00080000:1.0:1788521810.192090:0:10083:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788521810.194783:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c3fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521810.194813:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00010000:00010000:0.0:1788521810.194879:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c3fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.194888:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c3fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.194895:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521810.194901:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c3fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.194910:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c3fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521810.194918:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799078400 00000100:00100000:2.0:1788521810.194933:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799078400 00010000:00010000:0.0:1788521810.194933:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:0.0:1788521810.194939:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521810.194946:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c3fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.194954:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c3fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521810.195193:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 106 00000100:00100000:2.0:1788521810.195207:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadfce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+52:10533:x1875400799078400:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:2.0:1788521810.195239:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521810.195262:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c404 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00ae3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.195369:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c40b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.195386:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c3ef lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00adc expref: 53 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.195396:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c40b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.195439:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c3ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00adc expref: 53 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.195490:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c3ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00adc expref: 53 pid: 5834 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521810.195508:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f5a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875400816918016:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788521810.196257:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb4905780 going to sleep for 11 seconds 00000100:00100000:2.0:1788521810.198788:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521810.198972:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f5a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875400816918016:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788521810.199015:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c40b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521810.199329:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799078528 00000100:00100000:3.0:1788521810.199339:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799078528 00010000:00010000:3.0:1788521810.199392:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c3ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00adc expref: 54 pid: 5834 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521810.199438:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 53 00000100:00100000:3.0:1788521810.199450:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+54:2363:x1875400799078528:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521810.199467:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521810.199475:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c3ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00adc expref: 54 pid: 5834 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.199499:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c3ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00adc expref: 54 pid: 5834 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.199536:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c3ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00adc expref: 54 pid: 5834 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.199759:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:3.0:1788521810.199766:0:7633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c40b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.199777:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c40b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.199788:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c40b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.199821:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521810.199899:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+53:2363:x1875400799078528:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 451us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521810.199908:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 53 00010000:00010000:1.0:1788521810.200331:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c40b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.200340:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c40b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521810.200400:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788521810.200406:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521810.200430:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c40b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.200469:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c404 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ae3 expref: 53 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.200487:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c40b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ae3 expref: 52 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.200495:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:1.0:1788521810.200498:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521810.200501:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490ae00, rc 0) 00000100:00100000:1.0:1788521810.200626:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadfce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+52:10533:x1875400799078400:12345-192.168.206.48@tcp:101:bash.0 Request processed in 5422us (5824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521810.200634:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 106 00000100:00100000:2.0:1788521810.205291:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521810.205561:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799078784 00000100:00100000:3.0:1788521810.205574:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799078784 00000100:00100000:3.0:1788521810.205648:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 29 00000100:00100000:3.0:1788521810.205660:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+52:10533:x1875400799078784:12345-192.168.206.48@tcp:35:bash.0 00000100:00100000:1.0:1788521810.206549:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+53:10533:x1875400799078784:12345-192.168.206.48@tcp:35:bash.0 Request processed in 885us (1414us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1788521810.206561:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 29 00000100:00100000:2.0:1788521810.265360:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521810.266115:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799078912 00000100:00100000:1.0:1788521810.266130:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799078912 00000100:00100000:1.0:1788521810.266224:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 107 00000100:00100000:1.0:1788521810.266235:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+53:10539:x1875400799078912:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1788521810.266266:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521810.266293:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927c412 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00aea expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.266388:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c419 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.266404:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.266419:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521810.266461:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788521810.266465:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521810.266484:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.266513:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927c412 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00aea expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.266548:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c419 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00aea expref: 54 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.266558:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:1.0:1788521810.266561:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788521810.266566:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d5a00, rc 0) 00000100:00100000:1.0:1788521810.266637:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+54:10539:x1875400799078912:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 403us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521810.266653:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 107 00000100:00100000:0.0:1788521810.269413:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521810.269571:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799079040 00000100:00100000:1.0:1788521810.269584:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799079040 00000100:00100000:1.0:1788521810.269648:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 108 00000100:00100000:1.0:1788521810.269658:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad92a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+54:10539:x1875400799079040:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1788521810.269683:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521810.269710:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c420 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00af1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.269803:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c427 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.269823:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c427 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.269836:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c427 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.269854:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c42e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.269860:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c42e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.269867:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c42e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.270383:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c435 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.270414:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.270423:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521810.270471:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788521810.270476:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521810.270501:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.270516:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.270540:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c427 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.270546:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c427 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.270554:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c427 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.270561:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d4000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521810.270566:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c427 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.270574:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c427 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.270587:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:1.0:1788521810.270591:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521810.270604:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c427 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.270612:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c427 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.270627:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c42e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.270635:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c42e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.270641:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c42e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.270648:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521810.270652:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c42e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.270658:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c42e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.270667:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996fa0d5c900) 00010000:00010000:1.0:1788521810.270669:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521810.270673:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c42e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.270679:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c42e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.270720:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c420 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00af1 expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.270749:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c435 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00af1 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.270758:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:1.0:1788521810.270760:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521810.270763:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d4400, rc 0) 00000100:00100000:1.0:1788521810.271262:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad92a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+55:10539:x1875400799079040:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 1600us (1860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521810.271272:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 108 00000100:00100000:3.0:1788521810.276901:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521810.276944:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799079168 00000100:00100000:3.0:1788521810.276956:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799079168 00000100:00100000:3.0:1788521810.277112:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:3.0:1788521810.277127:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+55:2363:x1875400799079168:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521810.277173:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521810.277210:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c435 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00af1 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.277237:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:3.0:1788521810.277244:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521810.277314:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+54:2363:x1875400799079168:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 191us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521810.277324:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:3.0:1788521810.277387:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521810.277967:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799079424 00000100:00100000:3.0:1788521810.277976:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799079424 00000100:00100000:3.0:1788521810.278028:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 109 00000100:00100000:3.0:1788521810.278038:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+54:10539:x1875400799079424:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521810.278058:0:10083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521810.278079:0:10083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c43c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00af8 expref: -99 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.278269:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c443 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.278285:0:10083:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c40b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ae3 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.278292:0:10083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c443 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.278456:0:10083:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c40b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ae3 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.278481:0:10083:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c40b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ae3 expref: 55 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521810.278497:0:10083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a7d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10083:1875400816918144:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788521810.278667:0:10083:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f88783240 going to sleep for 11 seconds 00000100:00100000:1.0:1788521810.283430:0:10083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a7d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10083:1875400816918144:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788521810.283476:0:10083:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c443 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521810.284476:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521810.284656:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799079552 00000100:00100000:1.0:1788521810.284669:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799079552 00010000:00010000:1.0:1788521810.284727:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c40b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ae3 expref: 56 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521810.284772:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 54 00000100:00100000:1.0:1788521810.284783:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f856e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+56:2364:x1875400799079552:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521810.284803:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521810.284811:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c40b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ae3 expref: 56 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.284836:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c40b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ae3 expref: 56 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.284883:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c40b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ae3 expref: 56 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.285304:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:1.0:1788521810.285311:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c443 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.285324:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c443 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.285333:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c443 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.285370:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521810.285440:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f856e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+55:2364:x1875400799079552:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 658us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521810.285449:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 54 00010000:00010000:0.0:1788521810.285571:0:10083:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c443 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.285579:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c443 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521810.285602:0:10083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788521810.285783:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c43c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00af8 expref: 56 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.285802:0:10083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c443 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00af8 expref: 55 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.285810:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:0.0:1788521810.285813:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788521810.285815:0:10083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f80030600, rc 0) 00000100:00100000:0.0:1788521810.285844:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+55:10539:x1875400799079424:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 7809us (8460us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1788521810.285852:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 109 00000100:00100000:3.0:1788521810.289715:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521810.293082:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799079808 00000100:00100000:1.0:1788521810.293104:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799079808 00000100:00100000:1.0:1788521810.293326:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:1.0:1788521810.293339:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+55:10539:x1875400799079808:12345-192.168.206.48@tcp:103:lfs.0 00010000:00010000:1.0:1788521810.293358:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521810.293585:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927c3a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ace expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.293613:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:1.0:1788521810.293619:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521810.293720:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+54:10539:x1875400799079808:12345-192.168.206.48@tcp:103:lfs.0 Request processed in 383us (4020us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521810.293807:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:0.0:1788521810.306343:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521810.306457:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799079936 00000100:00100000:1.0:1788521810.306471:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799079936 00000100:00100000:1.0:1788521810.306556:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 110 00000100:00100000:1.0:1788521810.306570:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+54:10539:x1875400799079936:12345-192.168.206.48@tcp:58:lfs.0 00010000:00010000:1.0:1788521810.306745:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c451 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.306768:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c451 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.306783:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c451 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788521810.307099:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788521810.307237:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+54:10539:x1875400799079936:12345-192.168.206.48@tcp:58:lfs.0 Request processed in 667us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521810.307246:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 110 00000100:00100000:0.0:1788521810.309860:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521810.310070:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799080064 00000100:00100000:1.0:1788521810.310083:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799080064 00000100:00100000:1.0:1788521810.310218:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 111 00000100:00100000:1.0:1788521810.310232:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+54:10539:x1875400799080064:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1788521810.310258:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521810.310286:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927c458 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00aff expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.310378:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c451 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.310409:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927c458 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00aff expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.310433:0:5833:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c451 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.310449:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927c458 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00aff expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.310468:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:1.0:1788521810.310471:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788521810.310475:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927c458 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00aff expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.310484:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d4600, rc 0) 00000100:00100000:1.0:1788521810.310570:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+55:10539:x1875400799080064:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 342us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521810.310579:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 111 00000001:00080000:1.0:1788521810.316278:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1788521810.316307:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000040:00080000:1.0:1788521810.510916:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788521810.510930:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788521810.511005:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788521810.511019:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788521810.511843:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fadfcc700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1875400816918272:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788521810.511981:0:11682:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f91285180 going to sleep for 11 seconds 00000100:00100000:1.0:1788521810.516560:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fadfcc700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1875400816918272:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788521810.522893:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521810.523002:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799080192 00000100:00100000:2.0:1788521810.523020:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799080192 00000100:00100000:2.0:1788521810.523120:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 112 00000100:00100000:2.0:1788521810.523132:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadfcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+55:10540:x1875400799080192:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788521810.523220:0:5835:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788521810.523439:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadfcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+55:10540:x1875400799080192:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 308us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521810.523446:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 112 00000100:00100000:0.0:1788521810.526948:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521810.527278:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799080320 00000100:00100000:1.0:1788521810.527288:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799080320 00000100:00100000:1.0:1788521810.527363:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 113 00000100:00100000:1.0:1788521810.527374:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb42dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+55:10540:x1875400799080320:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788521810.527446:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927c45f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.527471:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927c45f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.527484:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927c45f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.527502:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c466 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.527510:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c466 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.527529:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c466 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.527553:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c46d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.527562:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c46d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.527568:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c46d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521810.527621:0:10083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788521810.527626:0:10083:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521810.527639:0:10083:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c46d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.527650:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927c45f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.527657:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927c45f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.527664:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927c45f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.527670:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d4e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521810.527674:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927c45f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.527683:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927c45f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.527697:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996fb19efc00) 00010000:00010000:1.0:1788521810.527700:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521810.527705:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927c45f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.527712:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927c45f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.527726:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c466 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.527742:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c466 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.527747:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c466 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.527752:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521810.527755:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c466 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.527761:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c466 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.527774:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff996fa0d5c900) 00010000:00010000:1.0:1788521810.527777:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521810.527780:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c466 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.527785:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c466 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.527801:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c46d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.527806:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c46d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.527812:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c46d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.527816:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521810.527824:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c46d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.527830:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c46d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.527837:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:1.0:1788521810.527840:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521810.527842:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c46d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.527848:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c46d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521810.527922:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb42dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+55:10540:x1875400799080320:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 Request processed in 550us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521810.527930:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 113 00000100:00100000:3.0:1788521810.529838:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521810.530711:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799080576 00000100:00100000:2.0:1788521810.530728:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799080576 00000100:00100000:2.0:1788521810.530791:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 114 00000100:00100000:2.0:1788521810.530801:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+55:10540:x1875400799080576:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521810.530820:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521810.530840:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c474 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00b06 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.530932:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c47b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.530960:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c47b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.530972:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c47b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521810.530984:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788521810.531084:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c47b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.531091:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c47b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.531097:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c47b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.531102:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490ae00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521810.531106:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c47b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.531114:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c47b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.531126:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:2.0:1788521810.531129:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788521810.531134:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c47b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.531164:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c47b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.531208:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c474 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b06 expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.531226:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996fb19efc00) 00010000:00010000:2.0:1788521810.531229:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521810.531234:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c474 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b06 expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.531243:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490bc00, rc 0) 00000100:00100000:2.0:1788521810.531374:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+56:10540:x1875400799080576:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 505us (1475us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1788521810.531384:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 114 00000100:00100000:0.0:1788521810.538972:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521810.544578:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799080704 00000100:00100000:3.0:1788521810.544594:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799080704 00000100:00100000:3.0:1788521810.544665:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 115 00000100:00100000:3.0:1788521810.544676:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb42d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+56:10540:x1875400799080704:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788521810.544712:0:5833:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788521810.544853:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb42d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+56:10540:x1875400799080704:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 179us (5890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521810.544869:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 115 00000100:00100000:0.0:1788521810.557276:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521810.557371:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799080960 00000100:00100000:1.0:1788521810.557381:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799080960 00000100:00100000:1.0:1788521810.557442:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 116 00000100:00100000:1.0:1788521810.557452:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb42db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+56:10540:x1875400799080960:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788521810.557474:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521810.557477:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788521810.557509:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c419 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00aea expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.557540:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:1.0:1788521810.557546:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788521810.557559:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c489 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00b0d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788521810.558120:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1788521810.558408:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c490 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.558423:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c490 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.558433:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c490 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.558488:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c489 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b0d expref: 58 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.558506:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c490 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b0d expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.558515:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff996fa0d5c900) 00010000:00010000:1.0:1788521810.558527:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521810.558530:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d5800, rc 0) 00000100:00100000:1.0:1788521810.558590:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb42db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+57:10540:x1875400799080960:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 1139us (1322us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788521810.558598:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 116 00000100:00100000:0.0:1788521810.567210:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521810.567332:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799081216 00000100:00100000:1.0:1788521810.567342:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799081216 00000100:00100000:1.0:1788521810.567401:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 117 00000100:00100000:1.0:1788521810.567412:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb42da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+57:10540:x1875400799081216:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788521810.567680:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521810.568881:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c490 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b0d expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.568915:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff996fa0d5c900) 00010000:00010000:1.0:1788521810.568929:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788521810.568966:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c49e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.568982:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c49e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.568994:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c49e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.569965:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c4a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x561aba2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.569989:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c4a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x561aba2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.569999:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c4a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x561aba2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.570778:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c49e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.570790:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c49e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.570797:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c49e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.570803:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521810.570807:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c49e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.570814:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c49e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.570827:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:2.0:1788521810.570831:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521810.570836:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c49e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.570857:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c49e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.570872:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c4a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x561aba2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.570878:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c4a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x561aba2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.570883:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c4a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x561aba2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.570888:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521810.570891:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c4a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x561aba2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.570897:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c4a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x561aba2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.570905:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x561aba2f (ffff996fa0d5c100) 00010000:00010000:2.0:1788521810.570907:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521810.570911:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c4a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x561aba2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.570916:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c4a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x561aba2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521810.571033:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb42da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+56:10540:x1875400799081216:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 3619us (3828us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788521810.571042:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 117 00000100:00100000:1.0:1788521810.574501:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521810.577867:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799081344 00000100:00100000:2.0:1788521810.577887:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799081344 00000100:00100000:2.0:1788521810.578375:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 118 00000100:00100000:2.0:1788521810.578389:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadfcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+56:10540:x1875400799081344:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521810.578411:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521810.578437:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c4ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00b14 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.578476:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c4b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.578490:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c4b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.578501:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c4b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.578620:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c4ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b14 expref: 58 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.578641:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c4b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b14 expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.578650:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff996fb19ef400) 00010000:00010000:2.0:1788521810.578653:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788521810.578656:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490ae00, rc 0) 00000100:00100000:2.0:1788521810.578726:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadfcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+57:10540:x1875400799081344:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 342us (4233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521810.578733:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 118 00000100:00100000:0.0:1788521810.583455:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521810.583561:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799081600 00000100:00100000:1.0:1788521810.583573:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799081600 00000100:00100000:1.0:1788521810.583635:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 119 00000100:00100000:1.0:1788521810.583645:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb42db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+57:10540:x1875400799081600:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788521810.583725:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c4ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.583761:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c4ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.583774:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c4ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788521810.584034:0:10083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:1.0:1788521810.584272:0:10083:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000408a7f3 reply state 00000000acc54c38 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c4ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521810.584282:0:10083:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788521810.584372:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb42db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+59:10540:x1875400799081600:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 727us (924us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1788521810.584380:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 119 00010000:00010000:3.0:1788521810.588028:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c4ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.588046:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c4ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.588053:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c4ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.588058:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521810.588063:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c4ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.588070:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c4ba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.588085:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff996fb19ef400) 00010000:00010000:3.0:1788521810.588088:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788521810.588093:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c4ba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.588100:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c4ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521810.591025:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521810.591246:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799081728 00000100:00100000:2.0:1788521810.591256:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799081728 00000100:00100000:2.0:1788521810.591325:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 120 00000100:00100000:2.0:1788521810.591336:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb42d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+58:10540:x1875400799081728:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521810.591357:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521810.591377:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c4c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00b1b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.591684:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c4c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b1b expref: 59 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.591700:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c4c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b1b expref: 59 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.591718:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff996fb19ef400) 00010000:00010000:2.0:1788521810.591721:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788521810.591725:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490bc00, rc 0) 00000100:00100000:2.0:1788521810.591786:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb42d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+59:10540:x1875400799081728:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 453us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521810.591793:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 120 00000100:00100000:0.0:1788521810.600405:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521810.600572:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799081856 00000100:00100000:3.0:1788521810.601266:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799081856 00000100:00100000:2.0:1788521810.605513:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 37 00000100:00100000:2.0:1788521810.605540:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb42d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+8:2363:x1875400799081856:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788521810.606342:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb42d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+9:2363:x1875400799081856:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 803us (5944us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788521810.606353:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 37 00000100:00100000:0.0:1788521810.619299:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521810.619400:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799082112 00000100:00100000:1.0:1788521810.619411:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799082112 00000100:00100000:1.0:1788521810.619476:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 30 00000100:00100000:1.0:1788521810.619488:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb42d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+59:10540:x1875400799082112:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788521810.619750:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb42d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+60:10540:x1875400799082112:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 263us (458us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1788521810.619758:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 30 00000100:00100000:0.0:1788521810.631644:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521810.632487:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799082368 00000100:00100000:3.0:1788521810.632500:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799082368 00000100:00100000:3.0:1788521810.632651:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 121 00000100:00100000:3.0:1788521810.632662:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb42d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+60:10540:x1875400799082368:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788521810.632852:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb42d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+60:10540:x1875400799082368:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 191us (1218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521810.632861:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 121 00000100:00100000:3.0:1788521810.647019:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521810.647193:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799082496 00000100:00100000:1.0:1788521810.647204:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799082496 00000100:00100000:1.0:1788521810.647265:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 122 00000100:00100000:1.0:1788521810.647276:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+60:10540:x1875400799082496:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788521810.647306:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521810.647327:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927c4c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00b22 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.647427:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c4cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.647442:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c4cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.647454:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c4cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521810.647489:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521810.647507:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c4cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.647542:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927c4c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b22 expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.647559:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c4cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b22 expref: 61 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.647568:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff996fb19ef400) 00010000:00010000:1.0:1788521810.647570:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788521810.647574:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d5600, rc 0) 00000100:00100000:1.0:1788521810.647635:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+61:10540:x1875400799082496:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 361us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521810.647642:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 122 00000100:00100000:2.0:1788521810.659318:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521810.659545:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799082624 00000100:00100000:3.0:1788521810.659554:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799082624 00000100:00100000:3.0:1788521810.659613:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 38 00000100:00100000:3.0:1788521810.659623:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc7d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+9:2362:x1875400799082624:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521810.659640:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521810.659660:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927c4d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00b29 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788521810.659685:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9aad52, blocks: 0x1 00010000:00010000:3.0:1788521810.659704:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=310s v=(0 0) 00010000:00010000:3.0:1788521810.659709:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521810.659727:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927c4d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b29 expref: 10 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.659748:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927c4d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b29 expref: 10 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.659762:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f80031a00, rc 0) 00000100:00100000:3.0:1788521810.659935:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc7d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+10:2362:x1875400799082624:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 313us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521810.659944:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 38 00000100:00100000:2.0:1788521810.666538:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521810.666790:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799082880 00000100:00100000:1.0:1788521810.666800:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799082880 00000100:00100000:1.0:1788521810.666907:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 123 00000100:00100000:1.0:1788521810.666933:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+61:10540:x1875400799082880:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788521810.667089:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+61:10540:x1875400799082880:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 157us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521810.667097:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 123 00000100:00100000:0.0:1788521810.670684:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521810.671053:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799083008 00000100:00100000:1.0:1788521810.671062:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799083008 00000100:00100000:1.0:1788521810.671122:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 39 00000100:00100000:1.0:1788521810.671132:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb42daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+10:10540:x1875400799083008:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788521810.671181:0:11097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521810.671208:0:11097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000728975b2/0x1b7b50db5927c4dd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00b30 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.671240:0:11097:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927c4d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b29 expref: 11 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.671249:0:11097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521810.671253:0:11097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521810.671258:0:11097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000728975b2/0x1b7b50db5927c4dd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b30 expref: 11 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.671293:0:11097:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927c4d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b29 expref: 11 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.671313:0:11097:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927c4d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b29 expref: 11 pid: 6687 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521810.671349:0:11097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fadfcc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11097:1875400816918400:192.168.206.48@tcp:104: 00000100:00100000:1.0:1788521810.671699:0:11097:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f91285180 going to sleep for 11 seconds 00000100:00100000:3.0:1788521810.674929:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521810.675123:0:11097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fadfcc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11097:1875400816918400:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788521810.675182:0:11097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000728975b2/0x1b7b50db5927c4dd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b30 expref: 11 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.675270:0:11097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d4e00, rc 0) 00000100:00100000:1.0:1788521810.675326:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb42daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+11:10540:x1875400799083008:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 4195us (4650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521810.675335:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 39 00000100:00100000:0.0:1788521810.676706:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799083136 00000100:00100000:0.0:1788521810.676718:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799083136 00010000:00010000:0.0:1788521810.676763:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927c4d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b29 expref: 11 pid: 6687 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521810.676984:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 55 00000100:00100000:0.0:1788521810.676994:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+11:2363:x1875400799083136:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521810.677010:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521810.677031:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927c4d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b29 expref: 11 pid: 6687 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.677051:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927c4d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b29 expref: 11 pid: 6687 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.677073:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927c4d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b29 expref: 11 pid: 6687 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.677091:0:7632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521810.677095:0:7632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521810.677104:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000728975b2/0x1b7b50db5927c4dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b30 expref: 10 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.677114:0:7632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000728975b2/0x1b7b50db5927c4dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b30 expref: 10 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.677220:0:7632:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000728975b2/0x1b7b50db5927c4dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b30 expref: 10 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521810.677234:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb42d9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7632:1875400816918528:192.168.206.48@tcp:105: 00000100:00100000:0.0:1788521810.677311:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f85cc4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788521810.683489:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521810.683681:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799083264 00000100:00100000:3.0:1788521810.683690:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799083264 00002000:00100000:3.0:1788521810.683741:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff996fbc441880 x1875400799083264/t0(0) o4->4bd13e8f-aac9-42ad-8625-a542705d6920@192.168.206.48@tcp:56/0 lens 504/0 e 0 to 0 dl 1788521821 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788521810.683752:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff996fbc441880 with x1875400799083264 ext(0->12) 00002000:00010000:3.0:1788521810.683758:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996fbc441880 00000100:00100000:3.0:1788521810.683790:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:3.0:1788521810.683800:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+11:2364:x1875400799083264:12345-192.168.206.48@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788521810.684606:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb42d9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7632:1875400816918528:192.168.206.48@tcp:105: 00010000:00010000:0.0:1788521810.684628:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521810.684779:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+13:2364:x1875400799083264:12345-192.168.206.48@tcp:4:lhsmtool_posix.0 Request processed in 979us (1299us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788521810.684790:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 2 00002000:00100000:3.0:1788521810.684799:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff996fbc441880 x1875400799083264/t4294967308(0) o4->4bd13e8f-aac9-42ad-8625-a542705d6920@192.168.206.48@tcp:56/0 lens 504/448 e 0 to 0 dl 1788521821 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788521810.684809:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff996fbc441880 with x1875400799083264 ext(0->12) 00002000:00010000:3.0:1788521810.684813:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996fbc441880 00000100:00100000:0.0:1788521810.687003:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+12:2363:x1875400799083136:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 10000us (12072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521810.687017:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 55 00000100:00100000:3.0:1788521810.689245:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521810.689469:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799083392 00000100:00100000:1.0:1788521810.689480:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799083392 00000100:00100000:1.0:1788521810.689543:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 124 00000100:00100000:1.0:1788521810.689554:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+61:10540:x1875400799083392:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788521810.742050:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967396 is committed 00000100:00100000:2.0:1788521810.742092:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+48:10540:x1875400799083392:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 Request processed in 52534us (52850us total) trans 0 rc 0/0 00000001:00080000:0.0:1788521810.742100:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000100:00100000:2.0:1788521810.742111:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 124 00000004:00080000:0.0:1788521810.742276:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:2.0:1788521810.742508:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816918656:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788521810.742585:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788521810.742952:0:5856:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:0.0:1788521810.742967:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1788521810.742981:0:5856:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff996fb18fa6c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788521810.742985:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff996f988a7900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff996fb18fa000 00000020:00080000:0.0:1788521810.742989:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff996f988a7e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff996fb7eed800 00000020:00080000:0.0:1788521810.743006:0:5856:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff996f86989900 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788521810.743009:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff996fad967000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff996f86989600 00000020:00080000:0.0:1788521810.743011:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff996fad967f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff996fb1913c00 00000020:00080000:0.0:1788521810.743027:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1788521810.743251:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788521810.743375:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788521810.743385:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb42d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816918784:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788521810.743419:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521810.743453:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816918656 00000100:00100000:2.0:1788521810.743459:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816918656 00000100:00100000:2.0:1788521810.743497:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816918784 00000100:00100000:2.0:1788521810.743500:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816918784 00000100:00100000:2.0:1788521810.743534:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788521810.743558:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1875400816918656:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788521810.743584:0:6687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1788521810.743607:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c4bce6b/0x1b7b50db5927c4e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.743640:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000babcc19f/0x1b7b50db5927c2a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a8f expref: 11 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.743650:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788521810.743654:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788521810.743658:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c4bce6b/0x1b7b50db5927c4e4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.743699:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000babcc19f/0x1b7b50db5927c2a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a8f expref: 11 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.743730:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000babcc19f/0x1b7b50db5927c2a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a8f expref: 11 pid: 11097 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521810.743743:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc6fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6687:1875400816918912:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788521810.743790:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb49053c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521810.743807:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788521810.743814:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc441180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816918784:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788521810.743827:0:6689:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:2.0:1788521810.743850:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9aad52, atime: 0x6a9aad52, ctime: 0x6a9aad52, blocks: 0xb 00010000:00010000:2.0:1788521810.743856:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002792d343/0x1b7b50db5927c4eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.743865:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=310s v=(0 0) 00010000:00010000:2.0:1788521810.743868:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521810.743873:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002792d343/0x1b7b50db5927c4eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.743887:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002792d343/0x1b7b50db5927c4eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.743897:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002792d343/0x1b7b50db5927c4eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.743913:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002792d343/0x1b7b50db5927c4eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.743930:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788521810.744435:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc441180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1875400816918784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 620us (1013us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788521810.744443:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:2.0:1788521810.744465:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521810.744471:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002792d343/0x1b7b50db5927c4eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.744479:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490ac00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:2.0:1788521810.744484:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002792d343/0x1b7b50db5927c4eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.744493:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002792d343/0x1b7b50db5927c4eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.744509:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002792d343/0x1b7b50db5927c4eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.744533:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002792d343/0x1b7b50db5927c4eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.744552:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521810.744563:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521810.744566:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521810.745533:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521810.745870:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1788521810.745877:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:1.0:1788521810.745900:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff996fad92aa00, transno 4294967301 00000004:00080000:1.0:1788521810.745915:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:1.0:1788521810.745932:0:3304:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff996fb42d9c00 x1875400816918784/t4294967304(4294967304) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788521826 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788521810.745944:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff996fb42d9c00/2, rc 0, transno 4294967304 00000100:00100000:1.0:1788521810.745949:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb42d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816918784:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788521810.746473:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799083520 00000100:00100000:2.0:1788521810.746481:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799083520 00000100:00100000:2.0:1788521810.746651:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 42 00000100:00100000:2.0:1788521810.746662:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadfcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+12:2363:x1875400799083520:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788521810.747436:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521810.747696:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc6fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6687:1875400816918912:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788521810.748226:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003c4bce6b/0x1b7b50db5927c4e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521810.748385:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799083648 00000100:00100000:1.0:1788521810.748392:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799083648 00010000:00010000:1.0:1788521810.748421:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000babcc19f/0x1b7b50db5927c2a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a8f expref: 13 pid: 11097 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521810.748453:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 56 00000100:00100000:1.0:1788521810.748464:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb42d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+13:2363:x1875400799083648:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521810.748476:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521810.748484:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000babcc19f/0x1b7b50db5927c2a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a8f expref: 13 pid: 11097 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.748503:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000babcc19f/0x1b7b50db5927c2a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a8f expref: 13 pid: 11097 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.748534:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000babcc19f/0x1b7b50db5927c2a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a8f expref: 13 pid: 11097 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.748560:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788521810.748565:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788521810.748571:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003c4bce6b/0x1b7b50db5927c4e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.748581:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c4bce6b/0x1b7b50db5927c4e4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.748600:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521810.748681:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb42d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+12:2363:x1875400799083648:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 217us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521810.748689:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 56 00010000:00010000:2.0:1788521810.750920:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003c4bce6b/0x1b7b50db5927c4e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.750940:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c4bce6b/0x1b7b50db5927c4e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.750951:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c4bce6b/0x1b7b50db5927c4e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.750959:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c4bce6b/0x1b7b50db5927c4e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.750979:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788521810.752041:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3304:x1875400816918656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8480us (9450us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788521810.752053:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1788521810.752095:0:7631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521810.752116:0:7631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c4bce6b/0x1b7b50db5927c4e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.752127:0:7631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490b200 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:2.0:1788521810.752132:0:7631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c4bce6b/0x1b7b50db5927c4e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.752169:0:7631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c4bce6b/0x1b7b50db5927c4e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.752191:0:7631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c4bce6b/0x1b7b50db5927c4e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.752200:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c4bce6b/0x1b7b50db5927c4e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.752220:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521810.752222:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521810.752224:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788521810.752392:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff996fb7a7e300/2, rc 0, transno 4294967309 00000100:00100000:1.0:1788521810.752410:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816918656:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1788521810.797111:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1788521810.797127:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1788521810.797134:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:1.0:1788521810.797139:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:2.0:1788521810.797341:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadfcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2363:x1875400799083520:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 Request processed in 50675us (51817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521810.797352:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 42 00000100:00100000:0.0:1788521810.801308:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521810.801401:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799083904 00000100:00100000:3.0:1788521810.801411:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799083904 00000100:00100000:3.0:1788521810.801477:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 125 00000100:00100000:3.0:1788521810.801488:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb42d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+15:10540:x1875400799083904:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788521810.801561:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521810.801588:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c4cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b22 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.801629:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff996fb19ef400) 00010000:00010000:3.0:1788521810.801635:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788521810.801666:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c4f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.801679:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c4f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.801689:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c4f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788521810.802969:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c56432fb reply state 00000000afe90d48 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c4f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521810.802983:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788521810.803384:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb42d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+16:10540:x1875400799083904:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 1894us (2082us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1788521810.803394:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 125 00010000:00010000:0.0:1788521810.806361:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c4f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.806378:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c4f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.806385:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c4f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.806391:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80030400 already unused, calling callback (ffffffffc20e54f0) 00000100:00100000:1.0:1788521810.806392:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00010000:00010000:0.0:1788521810.806395:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c4f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.806404:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c4f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.806421:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff996fb19ef400) 00010000:00010000:0.0:1788521810.806425:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521810.806430:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c4f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.806436:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c4f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521810.806496:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799084032 00000100:00100000:2.0:1788521810.806505:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799084032 00000100:00100000:2.0:1788521810.806571:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 43 00000100:00100000:2.0:1788521810.806580:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadfcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2364:x1875400799084032:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788521810.806785:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788521810.806801:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788521810 00002000:00010000:2.0:1788521810.806803:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788521810 00002000:00010000:2.0:1788521810.806806:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788521810 -> 1788521810 00002000:00010000:2.0:1788521810.806808:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788521810.806865:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadfcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2364:x1875400799084032:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 286us (476us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788521810.806872:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 43 00000100:00100000:1.0:1788521810.812027:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521810.812115:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799084288 00000100:00100000:2.0:1788521810.812124:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799084288 00000100:00100000:2.0:1788521810.812213:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 126 00000100:00100000:2.0:1788521810.812223:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadfcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+15:10540:x1875400799084288:12345-192.168.206.48@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788521810.812293:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c4f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.812309:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c4b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b14 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.812319:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c4f9 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.812350:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c4b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b14 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.812369:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c4b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b14 expref: 15 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521810.812400:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc6fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875400816919040:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788521810.812483:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb47d3780 going to sleep for 11 seconds 00000100:00100000:0.0:1788521810.816059:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521810.816191:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc6fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875400816919040:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788521810.816219:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c4f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521810.816360:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799084416 00000100:00100000:1.0:1788521810.816366:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799084416 00010000:00010000:1.0:1788521810.816401:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c4b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b14 expref: 16 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521810.816438:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 57 00000100:00100000:1.0:1788521810.816447:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc1ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+16:2364:x1875400799084416:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521810.816460:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521810.816466:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c4b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b14 expref: 16 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.816484:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c4b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b14 expref: 16 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.816505:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c4b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b14 expref: 16 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.816552:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff996fb19ef400) 00010000:00010000:1.0:1788521810.816557:0:7633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c4f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.816566:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c4f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.816574:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c4f9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.816606:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521810.816664:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc1ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+15:2364:x1875400799084416:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 216us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521810.816671:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 57 00010000:00010000:3.0:1788521810.817542:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c4f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.817560:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c4f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.817590:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c4f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.817597:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c4f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.817617:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c4f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.817623:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490b200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521810.817627:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c4f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.817635:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c4f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.817646:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff996fb19ef400) 00010000:00010000:3.0:1788521810.817648:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788521810.817652:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c4f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.817658:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c4f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521810.817727:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadfcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+14:10540:x1875400799084288:12345-192.168.206.48@tcp:55:lhsmtool_posix.0 Request processed in 5505us (5707us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788521810.817736:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 126 00000100:00100000:0.0:1788521810.822189:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521810.822357:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799084544 00000100:00100000:2.0:1788521810.822367:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799084544 00000100:00100000:2.0:1788521810.822422:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 44 00000100:00100000:2.0:1788521810.822431:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc1ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2363:x1875400799084544:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788521810.822475:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002792d343/0x1b7b50db5927c500 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.822494:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000728975b2/0x1b7b50db5927c4dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b30 expref: 7 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.822501:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521810.822505:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788521810.822510:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002792d343/0x1b7b50db5927c500 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.822566:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000728975b2/0x1b7b50db5927c4dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b30 expref: 7 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.822586:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000728975b2/0x1b7b50db5927c4dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b30 expref: 7 pid: 11097 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521810.822613:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc6fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6687:1875400816919168:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788521810.822679:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb47d3780 going to sleep for 11 seconds 00000100:00100000:1.0:1788521810.830985:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521810.831186:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799084672 00000100:00100000:0.0:1788521810.831195:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799084672 00010000:00010000:0.0:1788521810.831230:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000728975b2/0x1b7b50db5927c4dd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b30 expref: 8 pid: 11097 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521810.831276:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 58 00000100:00100000:0.0:1788521810.831283:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadfcd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+8:2364:x1875400799084672:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521810.831297:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521810.831318:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000728975b2/0x1b7b50db5927c4dd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b30 expref: 8 pid: 11097 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.831337:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000728975b2/0x1b7b50db5927c4dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b30 expref: 8 pid: 11097 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.831359:0:7632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788521810.831364:0:7632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788521810.831370:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002792d343/0x1b7b50db5927c500 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.831380:0:7632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002792d343/0x1b7b50db5927c500 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.831398:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521810.831455:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadfcd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+8:2364:x1875400799084672:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 171us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521810.831461:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 58 00010000:00010000:2.0:1788521810.832235:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000728975b2/0x1b7b50db5927c4dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b30 expref: 7 pid: 11097 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521810.832250:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc6fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6687:1875400816919168:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788521810.832271:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002792d343/0x1b7b50db5927c500 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.832281:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002792d343/0x1b7b50db5927c500 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.832288:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002792d343/0x1b7b50db5927c500 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.832315:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002792d343/0x1b7b50db5927c500 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.832323:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002792d343/0x1b7b50db5927c500 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.832332:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002792d343/0x1b7b50db5927c500 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.832354:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490ac00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:2.0:1788521810.832360:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002792d343/0x1b7b50db5927c500 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.832368:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002792d343/0x1b7b50db5927c500 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.832383:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002792d343/0x1b7b50db5927c500 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.832390:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002792d343/0x1b7b50db5927c500 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521810.832460:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc1ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2363:x1875400799084544:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 Request processed in 10030us (10321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521810.832468:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 44 00000100:00100000:1.0:1788521810.836383:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521810.836568:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799084928 00000100:00100000:0.0:1788521810.836577:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799084928 00000100:00100000:0.0:1788521810.836631:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 127 00000100:00100000:0.0:1788521810.836641:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadfcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+14:10540:x1875400799084928:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788521810.836726:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c507 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.836744:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c507 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.836756:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c507 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.836940:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c50e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.836952:0:10083:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c4c1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b1b expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.836960:0:10083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c50e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.837001:0:10083:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c4c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b1b expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.837022:0:10083:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c4c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b1b expref: 15 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521810.837035:0:10083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc1adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10083:1875400816919296:192.168.206.48@tcp:104: 00000100:00100000:0.0:1788521810.837446:0:10083:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f87de50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521810.841259:0:10083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc1adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10083:1875400816919296:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788521810.841287:0:10083:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c50e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521810.842122:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521810.842234:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799085056 00000100:00100000:2.0:1788521810.842242:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799085056 00010000:00010000:2.0:1788521810.842274:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c4c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b1b expref: 16 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521810.842314:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 59 00000100:00100000:2.0:1788521810.842323:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadfcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+16:2363:x1875400799085056:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521810.842336:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521810.842356:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c4c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b1b expref: 16 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.842373:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c4c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b1b expref: 16 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.842394:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c4c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b1b expref: 16 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.842408:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff996fb19ef400) 00010000:00010000:2.0:1788521810.842413:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c50e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.842422:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c50e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.842429:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c50e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.842450:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521810.842504:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadfcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+15:2363:x1875400799085056:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 182us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521810.842511:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 59 00010000:00010000:0.0:1788521810.842742:0:10083:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c50e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521810.842751:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c50e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788521810.842928:0:10083:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1788521810.843062:0:10083:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1788521810.843105:0:10083:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1788521810.843221:0:10083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc1ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10083:1875400816919424:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788521810.843268:0:10083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521810.843291:0:10083:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f87de5900 going to sleep for 11 seconds 00000100:00100000:1.0:1788521810.843454:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816919424 00000100:00100000:1.0:1788521810.843460:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816919424 00000100:00100000:1.0:1788521810.843498:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788521810.843506:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc1af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10083:x1875400816919424:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788521810.843602:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc1af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10083:x1875400816919424:12345-0@lo:1000:mdt00_003.0 Request processed in 97us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521810.843618:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788521810.843698:0:10083:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1788521810.843703:0:10083:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:2.0:1788521810.843722:0:10083:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff996fb7a7e300 x1875400816918656/t4294967309(4294967309) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788521826 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521810.843734:0:10083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc1ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10083:1875400816919424:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788521810.844187:0:10083:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1788521810.844248:0:10083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc6fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10083:1875400816919552:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788521810.844294:0:10083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521810.844318:0:10083:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90d8f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521810.845056:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816919552 00000100:00100000:1.0:1788521810.845063:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816919552 00000100:00100000:1.0:1788521810.845113:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788521810.845123:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc6fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:10083:x1875400816919552:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788521810.845352:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc6fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:10083:x1875400816919552:12345-0@lo:1000:mdt00_003.0 Request processed in 231us (1057us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788521810.845360:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788521810.845775:0:10083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc6fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10083:1875400816919552:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788521810.845813:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c50e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.845824:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c50e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.845831:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c50e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.845986:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4001000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521810.845991:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c50e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.845998:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c50e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.846013:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff996fb19ef400) 00010000:00010000:3.0:1788521810.846016:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788521810.846020:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c50e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.846027:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c50e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.846057:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c451 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.846063:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c451 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.846068:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c451 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.846073:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d4a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521810.846076:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c451 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.846082:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c451 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.846101:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:3.0:1788521810.846103:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788521810.846110:0:10083:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927c458 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00aff expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.846122:0:10083:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927c458 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00aff expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.846131:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927c458 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00aff expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.846194:0:10083:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927c458 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00aff expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521810.846208:0:10083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10083:1875400816919680:192.168.206.48@tcp:105: 00000100:00100000:3.0:1788521810.846273:0:10083:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f88783240 going to sleep for 11 seconds 00000100:00100000:2.0:1788521810.851726:0:10083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10083:1875400816919680:192.168.206.48@tcp:105: 00010000:00010000:2.0:1788521810.851759:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c451 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.851769:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c451 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.851801:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c515 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.851815:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c515 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.851827:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c515 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.851837:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c515 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.851843:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c515 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.851850:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c515 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.851856:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490bc00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521810.851860:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c515 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.851885:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c515 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.851898:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:2.0:1788521810.851901:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521810.851905:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c515 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.851911:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c515 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.851921:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c507 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.851927:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c507 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.851933:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c507 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.851937:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4001400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521810.851940:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c507 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.851945:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c507 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.851953:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:2.0:1788521810.851955:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788521810.851958:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c507 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.851986:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c507 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521810.852229:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadfcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+18:10540:x1875400799084928:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 15588us (15853us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1788521810.852239:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 127 00000020:00080000:2.0:1788521810.852245:0:10083:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788521810.853101:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788521810.853108:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788521810.853629:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788521810.853638:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788521810.854333:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521810.855674:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799085184 00000100:00100000:1.0:1788521810.855688:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799085184 00000100:00100000:1.0:1788521810.855756:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 31 00000100:00100000:1.0:1788521810.855768:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc1ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+18:10539:x1875400799085184:12345-192.168.206.48@tcp:49:lfs.0 00000100:00100000:1.0:1788521810.855914:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc1ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+18:10539:x1875400799085184:12345-192.168.206.48@tcp:49:lfs.0 Request processed in 148us (1585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521810.855922:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 31 00000100:00100000:0.0:1788521810.857697:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521810.858109:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799085440 00000100:00100000:1.0:1788521810.858118:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799085440 00000100:00100000:1.0:1788521810.858199:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 32 00000100:00100000:1.0:1788521810.858209:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f97fd3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+18:10540:x1875400799085440:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788521810.858842:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788521810.858954:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1788521810.859001:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c51c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.859023:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c51c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.859035:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c51c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.859044:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c51c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.859051:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c51c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.859057:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c51c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521810.859076:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788521810.859195:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f97fd3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+20:10540:x1875400799085440:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 985us (1501us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1788521810.859203:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 32 00000020:00080000:1.0:1788521810.859208:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788521810.860689:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521810.860701:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c51c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.860710:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5a00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:2.0:1788521810.860714:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c51c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.860723:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c51c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.860738:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff996fa0d5ca00) 00010000:00010000:2.0:1788521810.860741:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788521810.860745:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c51c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.860750:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c51c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.860769:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521810.860771:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521810.860772:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521810.864766:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521810.864920:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799085696 00000100:00100000:1.0:1788521810.864930:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799085696 00000100:00100000:1.0:1788521810.865044:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 128 00000100:00100000:1.0:1788521810.865056:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+20:10539:x1875400799085696:12345-192.168.206.48@tcp:58:lfs.0 00000040:00080000:1.0:1788521810.866197:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788521810.866406:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+20:10539:x1875400799085696:12345-192.168.206.48@tcp:58:lfs.0 Request processed in 1350us (1646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521810.866416:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 128 00000100:00100000:3.0:1788521810.901644:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521810.905419:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799085824 00000100:00100000:2.0:1788521810.905449:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799085824 00000100:00100000:2.0:1788521810.905584:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 129 00000100:00100000:2.0:1788521810.905595:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+20:10542:x1875400799085824:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521810.905619:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521810.905638:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c523 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00b37 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.905700:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c52a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.905714:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c52a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.905725:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c52a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.905741:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c531 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.905747:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.905754:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.905968:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c538 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.905980:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c443 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00af8 expref: 21 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.905988:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c538 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.906028:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c443 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00af8 expref: 21 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.906047:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c443 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00af8 expref: 21 pid: 10083 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521810.906061:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb42d9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1875400816919808:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788521810.906170:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90d8f900 going to sleep for 11 seconds 00000100:00100000:2.0:1788521810.910687:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521810.910768:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799086080 00000100:00100000:1.0:1788521810.910850:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799086080 00000100:00100000:1.0:1788521810.911038:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:1.0:1788521810.911049:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb42db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+22:5597:x1875400799086080:12345-192.168.206.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788521810.911482:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb42db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+23:5597:x1875400799086080:12345-192.168.206.48@tcp:35:ldlm_bl.0 Request processed in 433us (801us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1788521810.911490:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:3.0:1788521810.911647:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb42d9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1875400816919808:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788521810.911682:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c538 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521810.915306:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521810.915395:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799086208 00000100:00100000:2.0:1788521810.915404:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799086208 00010000:00010000:2.0:1788521810.915439:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c443 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00af8 expref: 23 pid: 10083 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521810.915511:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 60 00000100:00100000:2.0:1788521810.915531:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f856e4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+23:2363:x1875400799086208:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521810.915607:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521810.915615:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c443 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00af8 expref: 23 pid: 10083 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.915635:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c443 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00af8 expref: 23 pid: 10083 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.915656:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c443 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00af8 expref: 23 pid: 10083 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.915688:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:2.0:1788521810.915693:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c538 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.915701:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.915709:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c538 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521810.915749:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521810.915840:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f856e4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+22:2363:x1875400799086208:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 310us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521810.915856:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 60 00010000:00010000:3.0:1788521810.915938:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.915947:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521810.916006:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788521810.916011:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788521810.916031:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.916043:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.916053:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c52a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.916059:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c52a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.916075:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c52a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.916081:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490a400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521810.916086:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c52a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.916093:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c52a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.916103:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:3.0:1788521810.916105:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521810.916109:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c52a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.916114:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c52a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.916135:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.916171:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c531 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.916178:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c531 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.916183:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490bc00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521810.916185:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c531 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.916191:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c531 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.916198:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996fb19ef200) 00010000:00010000:3.0:1788521810.916201:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521810.916204:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c531 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.916208:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c531 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.916241:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c523 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b37 expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.916253:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c538 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b37 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521810.916270:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:3.0:1788521810.916272:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521810.916274:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490b200, rc 0) 00000100:00100000:3.0:1788521810.916300:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+21:10542:x1875400799085824:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 10707us (14678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521810.916306:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 129 00010000:00010000:1.0:1788521811.088825:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521811.222434:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521811.222477:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521811.222504:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521811.222548:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521811.222588:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799086720 00000100:00100000:2.0:1788521811.222597:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799086720 00000100:00100000:2.0:1788521811.222653:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 122 00000100:00100000:2.0:1788521811.222662:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb42d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2361:x1875400799086720:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521811.222723:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb42d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2361:x1875400799086720:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 62us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521811.222730:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 122 00000100:00100000:2.0:1788521811.222760:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799086336 00000100:00100000:2.0:1788521811.222764:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799086336 00000100:00100000:2.0:1788521811.222798:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 279 00000100:00100000:2.0:1788521811.222804:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+13:2361:x1875400799086336:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521811.222826:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+13:2361:x1875400799086336:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 23us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521811.222832:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 279 00000100:00100000:2.0:1788521811.222856:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799086464 00000100:00100000:2.0:1788521811.222859:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799086464 00000100:00100000:2.0:1788521811.222878:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799086592 00000100:00100000:2.0:1788521811.222881:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799086592 00000100:00100000:2.0:1788521811.222897:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 68 00000100:00100000:2.0:1788521811.222902:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb42d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2361:x1875400799086464:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521811.222922:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb42d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2361:x1875400799086464:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 20us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521811.222928:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 68 00000100:00100000:2.0:1788521811.222936:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 69 00000100:00100000:2.0:1788521811.222941:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2361:x1875400799086592:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521811.222959:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2361:x1875400799086592:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 17us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521811.222965:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 69 00000100:00080000:2.0:1788521811.222977:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521811.222980:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788521811.222983:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1788521811.280407:0:6740:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 311265261146ns, next at 312265259178ns, rc = 0 00000100:00100000:2.0:1788521811.280500:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc1aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816919936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521811.280585:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521811.280885:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816919936 00000100:00100000:0.0:1788521811.280893:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816919936 00000100:00100000:0.0:1788521811.280953:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788521811.280963:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875400816919936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788521811.280985:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1788521811.281027:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875400816919936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521811.281033:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1788521811.281157:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521811.281192:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc1aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816919936:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788521811.818876:0:12104:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788521811.818885:0:12104:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788521811.818942:0:12104:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788521811.818947:0:12104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788521811.859710:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788521811.859720:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788521811.859771:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788521811.859778:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788521811.859902:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a7dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1875400816920064:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788521811.864914:0:11682:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f88783a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521811.885956:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521811.886025:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799086848 00000100:00100000:0.0:1788521811.886034:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799086848 00000100:00100000:0.0:1788521811.886101:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 130 00000100:00100000:0.0:1788521811.886111:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f8574b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+22:10554:x1875400799086848:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788521811.886177:0:10083:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788521811.886291:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f8574b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+22:10554:x1875400799086848:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 182us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521811.886299:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 130 00000100:00080000:2.0:1788521811.886564:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521811.886655:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a7dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1875400816920064:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788521811.911590:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521811.911691:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799087104 00000100:00100000:0.0:1788521811.911700:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799087104 00000100:00100000:0.0:1788521811.911756:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 131 00000100:00100000:0.0:1788521811.911765:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f8574b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+21:10554:x1875400799087104:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788521811.911785:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521811.911805:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c53f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00b3e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521811.911905:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001200/0x1b7b50db5927c546 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521811.911919:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001200/0x1b7b50db5927c546 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521811.911931:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001200/0x1b7b50db5927c546 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521811.911943:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788521811.912060:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c53f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b3e expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521811.912078:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001200/0x1b7b50db5927c546 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b3e expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521811.912086:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:0.0:1788521811.912089:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788521811.912102:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4001200, rc 0) 00000100:00100000:0.0:1788521811.912202:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f8574b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+23:10554:x1875400799087104:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 437us (621us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1788521811.912210:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 131 00000100:00100000:3.0:1788521811.926600:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521811.926801:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521811.927266:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799087360 00000100:00100000:3.0:1788521811.927275:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799087360 00000100:00100000:3.0:1788521811.927327:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 132 00000100:00100000:3.0:1788521811.927337:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+23:10554:x1875400799087360:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788521811.927414:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c554 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521811.927433:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c554 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521811.927446:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c554 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521811.927836:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c554 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521811.927845:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c554 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521811.927852:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c554 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521811.927858:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80030400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521811.927862:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c554 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521811.927870:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c554 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521811.927883:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:3.0:1788521811.927886:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788521811.927891:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c554 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521811.927897:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c554 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521811.928045:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+24:10554:x1875400799087360:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 708us (1454us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788521811.928054:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 132 00000040:00080000:3.0:1788521811.928807:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788521811.928814:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788521811.931249:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788521811.931278:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788521811.931872:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799087488 00000100:00100000:1.0:1788521811.931882:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799087488 00000100:00100000:1.0:1788521811.931946:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:1.0:1788521811.931956:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+24:2363:x1875400799087488:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521811.931971:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521811.931994:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001200/0x1b7b50db5927c546 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b3e expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521811.932010:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:1.0:1788521811.932015:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521811.932083:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+23:2363:x1875400799087488:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 129us (5282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521811.932091:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:2.0:1788521811.935664:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521811.935797:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799087744 00000100:00100000:3.0:1788521811.935807:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799087744 00000100:00100000:3.0:1788521811.935863:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 34 00000100:00100000:3.0:1788521811.935872:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+23:10554:x1875400799087744:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788521811.936079:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+24:10554:x1875400799087744:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 207us (421us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788521811.936086:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 34 00010000:00010000:3.0:1788521812.114050:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521813.134366:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788521813.657676:0:12155:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788521813.657686:0:12155:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788521813.657730:0:12155:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788521813.657741:0:12155:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788521813.803509:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521813.803543:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799088000 00000100:00100000:3.0:1788521813.803552:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799088000 00000100:00100000:3.0:1788521813.803609:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 133 00000100:00100000:3.0:1788521813.803620:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+24:10575:x1875400799088000:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521813.803641:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521813.803659:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c55b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00b45 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521813.803755:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c562 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521813.803769:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c562 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521813.803780:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c562 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521813.803790:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788521813.803895:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c55b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b45 expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521813.804316:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c562 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b45 expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521813.804325:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:3.0:1788521813.804328:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788521813.804332:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f80031400, rc 0) 00000100:00100000:3.0:1788521813.804420:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+26:10575:x1875400799088000:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 801us (928us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788521813.804427:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 133 00000100:00080000:3.0:1788521813.804450:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521813.820767:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521813.820856:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799088128 00000100:00100000:2.0:1788521813.820865:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799088128 00000100:00100000:2.0:1788521813.820960:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 134 00000100:00100000:2.0:1788521813.820971:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc1aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+26:10575:x1875400799088128:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:2.0:1788521813.821036:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c570 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521813.821053:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521813.821066:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521813.821091:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521813.821098:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c570 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521813.821105:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c570 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521813.821110:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490ae00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521813.821114:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c570 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521813.821122:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c570 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521813.821140:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:2.0:1788521813.821188:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521813.821194:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c570 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521813.821201:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927c570 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521813.821269:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc1aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+26:10575:x1875400799088128:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 300us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521813.821277:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 134 00000100:00100000:0.0:1788521813.908918:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521813.909083:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799088256 00000100:00100000:2.0:1788521813.909108:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799088256 00000100:00100000:2.0:1788521813.909212:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 45 00000100:00100000:2.0:1788521813.909223:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc1ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2361:x1875400799088256:12345-192.168.206.48@tcp:101:cat.0 00010000:00010000:2.0:1788521813.909241:0:11097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521813.909261:0:11097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc7be9d4/0x1b7b50db5927c577 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00b4c expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788521813.909272:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1788521813.909286:0:11097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9aad52, atime: 0x6a9aad52, ctime: 0x6a9aad52, blocks: 0xb 00010000:00010000:2.0:1788521813.909306:0:11097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=313s v=(0 0) 00010000:00010000:2.0:1788521813.909310:0:11097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521813.909319:0:11097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc7be9d4/0x1b7b50db5927c577 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b4c expref: 7 pid: 11097 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521813.909339:0:11097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bc7be9d4/0x1b7b50db5927c577 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b4c expref: 7 pid: 11097 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521813.909371:0:11097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490ae00, rc 0) 00000100:00100000:2.0:1788521813.909420:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc1ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2361:x1875400799088256:12345-192.168.206.48@tcp:101:cat.0 Request processed in 199us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521813.909427:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 45 00000100:00100000:1.0:1788521813.913982:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521813.914094:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799088384 00000100:00100000:0.0:1788521813.914105:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799088384 00002000:00100000:0.0:1788521813.914188:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff996fadfcf480 x1875400799088384/t0(0) o3->4bd13e8f-aac9-42ad-8625-a542705d6920@192.168.206.48@tcp:59/0 lens 488/0 e 0 to 0 dl 1788521824 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788521813.914200:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff996fadfcf480 with x1875400799088384 ext(0->4095) 00002000:00010000:0.0:1788521813.914205:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996fadfcf480 00000100:00100000:0.0:1788521813.914237:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:0.0:1788521813.914248:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadfcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2362:x1875400799088384:12345-192.168.206.48@tcp:3:cat.0 00000100:00100000:0.0:1788521813.914456:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadfcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2362:x1875400799088384:12345-192.168.206.48@tcp:3:cat.0 Request processed in 210us (485us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788521813.914463:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 3 00002000:00100000:0.0:1788521813.914470:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff996fadfcf480 x1875400799088384/t0(0) o3->4bd13e8f-aac9-42ad-8625-a542705d6920@192.168.206.48@tcp:59/0 lens 488/4536 e 0 to 0 dl 1788521824 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788521813.914478:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff996fadfcf480 with x1875400799088384 ext(0->4095) 00002000:00010000:0.0:1788521813.914482:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996fadfcf480 00010000:00010000:1.0:1788521814.158369:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521814.353511:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc1afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816920192:0@lo:400:kworker.0 00000100:00100000:0.0:1788521814.353511:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc1aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875400816920448:0@lo:400:kworker.0 00000100:00100000:2.0:1788521814.353611:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc1ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816920576:0@lo:400:kworker.0 00000100:00100000:1.0:1788521814.354002:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc1adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816920320:0@lo:400:kworker.0 00000100:00100000:0.0:1788521814.354379:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521814.354449:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816920448 00000100:00100000:0.0:1788521814.354455:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816920448 00000100:00100000:0.0:1788521814.354518:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788521814.354528:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc1af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875400816920448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521814.354592:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc1af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875400816920448:12345-0@lo:400:kworker.0 Request processed in 66us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521814.354599:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:0.0:1788521814.354621:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521814.354645:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc1aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875400816920448:0@lo:400:kworker.0 00000100:00100000:3.0:1788521814.355654:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521814.355730:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc1ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875400816920704:0@lo:400:kworker.0 00000100:00100000:3.0:1788521814.355762:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521814.355794:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816920704 00000100:00100000:3.0:1788521814.355799:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816920704 00000100:00100000:3.0:1788521814.355837:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788521814.355843:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875400816920704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521814.355879:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875400816920704:12345-0@lo:400:kworker.0 Request processed in 36us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521814.355885:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:3.0:1788521814.355899:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521814.355917:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc1ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875400816920704:0@lo:400:kworker.0 00000100:00100000:0.0:1788521814.356405:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816920192 00000100:00100000:0.0:1788521814.356411:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816920192 00000100:00100000:2.0:1788521814.356463:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521814.356504:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788521814.356514:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3307:x1875400816920192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521814.356589:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816920576 00000100:00100000:3.0:1788521814.356606:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816920576 00000100:00100000:3.0:1788521814.356655:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788521814.356665:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1875400816920576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521814.356671:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3307:x1875400816920192:12345-0@lo:400:kworker.0 Request processed in 158us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521814.356679:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788521814.356714:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1875400816920576:12345-0@lo:400:kworker.0 Request processed in 49us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521814.356722:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1788521814.356723:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521814.356766:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc1ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816920576:0@lo:400:kworker.0 00000100:00100000:2.0:1788521814.356772:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc1afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816920192:0@lo:400:kworker.0 00000100:00100000:1.0:1788521814.357035:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521814.357115:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc1af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816920832:0@lo:400:kworker.0 00000100:00100000:1.0:1788521814.357161:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521814.357246:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816920832 00000100:00100000:2.0:1788521814.357251:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816920832 00000100:00100000:2.0:1788521814.357332:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788521814.357340:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadfcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1875400816920832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521814.357379:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadfcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1875400816920832:12345-0@lo:400:kworker.0 Request processed in 41us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521814.357385:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788521814.357427:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816920320 00000100:00100000:0.0:1788521814.357432:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816920320 00000100:00100000:0.0:1788521814.357452:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788521814.357458:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadfcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816920320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521814.357484:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadfcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816920320:12345-0@lo:400:kworker.0 Request processed in 27us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521814.357489:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:3.0:1788521814.357569:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788521814.357597:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc1adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816920320:0@lo:400:kworker.0 00000100:00100000:3.0:1788521814.357607:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc1af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816920832:0@lo:400:kworker.0 00000100:00100000:3.0:1788521814.871832:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788521814.878767:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc1aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816920960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521814.878847:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521814.878944:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816920960 00000100:00100000:2.0:1788521814.878951:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816920960 00000100:00100000:2.0:1788521814.879014:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788521814.879023:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc1ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875400816920960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788521814.879058:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521814.879109:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc1ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875400816920960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521814.879114:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788521814.879239:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc1aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816920960:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788521815.183011:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788521815.431217:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1788521815.954688:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000004:00080000:2.0:1788521815.954705:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:2.0:1788521815.954739:0:5856:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1788521815.954760:0:5856:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff996fb47d33c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788521815.954764:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff996fb7a19500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff996fb47d3780 00000020:00080000:2.0:1788521815.954767:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff996fb7a19900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff996fb7878c00 00000001:00080000:2.0:1788521815.954773:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1788521815.955658:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1788521815.955848:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:3.0:1788521815.955906:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc1aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816921088:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788521815.955972:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521815.956304:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816921088 00000100:00100000:0.0:1788521815.956312:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816921088 00000100:00100000:0.0:1788521815.956363:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788521815.956373:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1875400816921088:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788521815.956558:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788521815.956561:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788521810 -> 1788521810 00002000:00010000:0.0:1788521815.956564:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 1788521810 -> 1788521810 00002000:00010000:0.0:1788521815.956566:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788521810 -> 1788521810 00002000:00010000:0.0:1788521815.956568:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788521815.956624:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3306:x1875400816921088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 252us (651us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788521815.956631:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000004:00080000:2.0:1788521815.956882:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff996fbc1aed80/2, rc 0, transno 4294967312 00000100:00100000:2.0:1788521815.956889:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc1aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816921088:0@lo:2:osp-syn-0-0.0 00000001:00080000:1.0:1788521815.984062:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1788521815.984093:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:1.0:1788521816.206913:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521816.334125:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521816.334181:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521816.334207:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521816.334225:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521816.334244:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521816.334269:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799088768 00000100:00100000:0.0:1788521816.334277:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799088768 00000100:00100000:0.0:1788521816.334323:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799088896 00000100:00100000:0.0:1788521816.334326:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799088896 00000100:00100000:0.0:1788521816.334348:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 72 00000100:00100000:0.0:1788521816.334357:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc1ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2363:x1875400799088768:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521816.334421:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc1ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2363:x1875400799088768:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 65us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521816.334428:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 72 00000100:00100000:0.0:1788521816.334445:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 73 00000100:00100000:0.0:1788521816.334450:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc1afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2363:x1875400799088896:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521816.334471:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc1afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2363:x1875400799088896:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 22us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521816.334476:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 73 00000100:00100000:0.0:1788521816.334503:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799089024 00000100:00100000:0.0:1788521816.334507:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799089024 00000100:00100000:0.0:1788521816.334536:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799088640 00000100:00100000:0.0:1788521816.334538:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799088640 00000100:00100000:0.0:1788521816.334554:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 126 00000100:00100000:0.0:1788521816.334561:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc1af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2363:x1875400799089024:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521816.334588:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc1af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2363:x1875400799089024:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 28us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521816.334594:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 126 00000100:00100000:0.0:1788521816.334605:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 127 00000100:00100000:0.0:1788521816.334611:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc1adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+13:2363:x1875400799088640:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521816.334632:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc1adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+13:2363:x1875400799088640:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 21us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521816.334638:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 127 00000100:00080000:0.0:1788521816.334658:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788521816.334663:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788521816.334665:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521816.336117:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799088512 00000100:00100000:3.0:1788521816.336128:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799088512 00000100:00100000:3.0:1788521816.336193:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 281 00000100:00100000:3.0:1788521816.336203:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+13:2363:x1875400799088512:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521816.336259:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+13:2363:x1875400799088512:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 57us (2142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521816.336265:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 281 00000100:00100000:2.0:1788521816.398862:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc1ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816921216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521816.398932:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521816.402821:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816921216 00000100:00100000:3.0:1788521816.402835:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816921216 00000100:00100000:3.0:1788521816.402981:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788521816.402993:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875400816921216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788521816.403046:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788521816.403136:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521816.406850:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875400816921216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3849us (7906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521816.406865:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788521816.407235:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1788521816.407241:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff996fb7a7e300, transno 4294967309 00000004:00080000:2.0:1788521816.407290:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:2.0:1788521816.407317:0:3307:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff996fbc1aed80 x1875400816921088/t4294967312(4294967312) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788521831 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521816.407339:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc1ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816921216:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788521817.230417:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521818.255602:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521818.537448:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521818.537649:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799089152 00000100:00100000:1.0:1788521818.537658:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799089152 00000100:00100000:1.0:1788521818.537734:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 135 00000100:00100000:1.0:1788521818.537745:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+13:10220:x1875400799089152:12345-192.168.206.48@tcp:60:lhsmtool_posix.0 00000100:00080000:0.0:1788521818.537760:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521818.537841:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+13:10220:x1875400799089152:12345-192.168.206.48@tcp:60:lhsmtool_posix.0 Request processed in 97us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521818.537849:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 135 00000100:00100000:1.0:1788521818.545223:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521818.545321:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799089408 00000100:00100000:2.0:1788521818.545331:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799089408 00000100:00100000:2.0:1788521818.545385:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 35 00000100:00100000:2.0:1788521818.545395:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadfcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+13:10220:x1875400799089408:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788521818.545702:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadfcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+14:10220:x1875400799089408:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 308us (486us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788521818.545709:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 35 00000100:00100000:0.0:1788521818.760193:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521818.761505:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799089536 00000100:00100000:2.0:1788521818.761518:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799089536 00000100:00100000:2.0:1788521818.761602:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 136 00000100:00100000:2.0:1788521818.761625:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc1ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:11027:x1875400799089536:12345-192.168.206.48@tcp:101:lsof.0 00010000:00010000:2.0:1788521818.761644:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521818.761713:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c57e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00b53 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521818.761773:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c585 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521818.761786:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c585 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521818.761798:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c585 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521818.761832:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788521818.761836:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521818.761874:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c585 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521818.761896:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c57e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b53 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521818.761913:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c585 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b53 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521818.761922:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:2.0:1788521818.761925:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788521818.761928:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490b600, rc 0) 00000100:00100000:2.0:1788521818.762044:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc1ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e406c42-03a1-40c3-937c-c3b114a3dde8+6:11027:x1875400799089536:12345-192.168.206.48@tcp:101:lsof.0 Request processed in 420us (1857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521818.762061:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 136 00000100:00080000:0.0:1788521818.762128:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788521819.278767:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521819.470639:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816921344:0@lo:400:kworker.0 00000100:00100000:0.0:1788521819.470721:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521819.470873:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816921344 00000100:00100000:1.0:1788521819.470882:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816921344 00000100:00100000:1.0:1788521819.470952:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788521819.470961:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3304:x1875400816921344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521819.471454:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb45a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875400816921472:0@lo:400:kworker.0 00000100:00100000:2.0:1788521819.471521:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521819.471565:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816921472 00000100:00100000:2.0:1788521819.471569:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816921472 00000100:00100000:2.0:1788521819.471603:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788521819.471610:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875400816921472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521819.471662:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875400816921472:12345-0@lo:400:kworker.0 Request processed in 51us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521819.471669:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788521819.471722:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb45a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875400816921472:0@lo:400:kworker.0 00000100:00100000:1.0:1788521819.476273:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3304:x1875400816921344:12345-0@lo:400:kworker.0 Request processed in 5307us (5545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521819.476288:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788521819.476345:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb45a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816921728:0@lo:400:kworker.0 00000100:00100000:2.0:1788521819.476394:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb45a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875400816921600:0@lo:400:kworker.0 00000100:00100000:3.0:1788521819.476396:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521819.476434:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521819.476440:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816921984:0@lo:400:kworker.0 00000100:00100000:3.0:1788521819.476462:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521819.476465:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816921600 00000100:00100000:2.0:1788521819.476481:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816921600 00000100:00100000:3.0:1788521819.476492:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788521819.476537:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788521819.476546:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875400816921600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521819.476591:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875400816921600:12345-0@lo:400:kworker.0 Request processed in 47us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521819.476598:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:2.0:1788521819.476614:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521819.476640:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb45a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875400816921600:0@lo:400:kworker.0 00000100:00100000:1.0:1788521819.476897:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816921728 00000100:00100000:1.0:1788521819.476920:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816921728 00000100:00100000:1.0:1788521819.477452:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816921984 00000100:00100000:1.0:1788521819.477482:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816921984 00000100:00100000:1.0:1788521819.477523:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788521819.477531:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1875400816921728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521819.477588:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1875400816921728:12345-0@lo:400:kworker.0 Request processed in 58us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521819.477595:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788521819.477608:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788521819.477613:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb45a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875400816921856:0@lo:400:kworker.0 00000100:00100000:1.0:1788521819.477614:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816921984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521819.477643:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521819.477643:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816921984:12345-0@lo:400:kworker.0 Request processed in 30us (1180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521819.477649:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788521819.477670:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788521819.477675:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff996fb42d9c00, transno 4294967304 00000100:00080000:2.0:1788521819.478445:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521819.478451:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521819.478467:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816921856 00000100:00100000:2.0:1788521819.478489:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816921856 00000100:00100000:2.0:1788521819.478547:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788521819.478554:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875400816921856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521819.478602:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875400816921856:12345-0@lo:400:kworker.0 Request processed in 49us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521819.478609:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788521819.478660:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb45a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816921728:0@lo:400:kworker.0 00000100:00100000:3.0:1788521819.478689:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816921984:0@lo:400:kworker.0 00000100:00080000:1.0:1788521819.478811:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521819.479569:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb45a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875400816921856:0@lo:400:kworker.0 00000100:00100000:0.0:1788521819.479684:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816921344:0@lo:400:kworker.0 00000100:00100000:1.0:1788521819.983795:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788521819.983818:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc1aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816922112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521819.983879:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521819.983995:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816922112 00000100:00100000:0.0:1788521819.984004:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816922112 00000100:00100000:0.0:1788521819.984065:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788521819.984076:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb42d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816922112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788521819.984110:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521819.984183:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb42d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816922112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521819.984191:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788521819.984342:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc1aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816922112:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1788521820.110388:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788521820.110397:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788521820.110682:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1788521820.110690:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788521820.302421:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788521821.044914:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000020:00080000:2.0:1788521821.046812:0:5856:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:2.0:1788521821.046836:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1788521821.046920:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788521821.046930:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1788521821.326413:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521821.457623:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521821.457662:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521821.457706:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521821.457732:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521821.457765:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521821.457770:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799090176 00000100:00100000:3.0:1788521821.457781:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799090176 00000100:00100000:0.0:1788521821.457790:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799089792 00000100:00100000:0.0:1788521821.457796:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799089792 00000100:00100000:0.0:1788521821.457866:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 131 00000100:00100000:0.0:1788521821.457877:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc1ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+13:2364:x1875400799089792:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521821.457884:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 132 00000100:00100000:3.0:1788521821.457895:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc1ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e406c42-03a1-40c3-937c-c3b114a3dde8+6:2364:x1875400799090176:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521821.457995:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799089920 00000100:00100000:2.0:1788521821.458000:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799089920 00000100:00100000:2.0:1788521821.458030:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799090048 00000100:00100000:2.0:1788521821.458033:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799090048 00000100:00100000:2.0:1788521821.458070:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 76 00000100:00100000:2.0:1788521821.458078:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc1ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2364:x1875400799089920:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521821.458451:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc1ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+13:2364:x1875400799089792:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 574us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521821.458470:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 131 00000100:00100000:1.0:1788521821.458636:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799089664 00000100:00100000:1.0:1788521821.458641:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799089664 00000100:00100000:3.0:1788521821.458672:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc1ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e406c42-03a1-40c3-937c-c3b114a3dde8+6:2364:x1875400799090176:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 777us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521821.458676:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 283 00000100:00100000:3.0:1788521821.458686:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 132 00000100:00100000:1.0:1788521821.458699:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+13:2364:x1875400799089664:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521821.458730:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+13:2364:x1875400799089664:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 45us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521821.458738:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 283 00000100:00100000:3.0:1788521821.458766:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 77 00000100:00100000:1.0:1788521821.458772:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788521821.458777:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc1adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2364:x1875400799090048:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521821.458790:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1788521821.458815:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc1adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2364:x1875400799090048:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 41us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521821.458823:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 77 00000100:00080000:1.0:1788521821.458825:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788521821.458830:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788521821.458834:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521821.460960:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc1ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2364:x1875400799089920:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 2874us (3287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521821.460974:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 76 00000100:00100000:2.0:1788521821.518866:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788521821.518892:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc1aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816922240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521821.518965:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521821.519279:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816922240 00000100:00100000:3.0:1788521821.519288:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816922240 00000100:00100000:3.0:1788521821.519354:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788521821.519363:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816922240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788521821.519395:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788521821.519400:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521821.519452:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816922240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521821.519470:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788521821.519562:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1788521821.519568:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff996fbc1aed80, transno 4294967312 00000100:00100000:2.0:1788521821.519593:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc1aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816922240:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788521822.354592:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788521822.424108:0:12359:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 07:37:01 (1788521821) 00010000:00010000:1.0:1788521823.374402:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521823.585322:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521823.585429:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799090432 00000100:00100000:0.0:1788521823.585440:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799090432 00000100:00100000:0.0:1788521823.585527:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 137 00000100:00100000:0.0:1788521823.585538:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+13:11292:x1875400799090432:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788521823.585558:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521823.585581:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001e00/0x1b7b50db5927c58c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00b5a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521823.585651:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c593 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521823.585666:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c593 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521823.585678:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c593 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521823.585741:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c59a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521823.585749:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c59a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521823.585756:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c59a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521823.586012:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c5a1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521823.586021:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c5a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521823.586027:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c5a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521823.586036:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788521823.586192:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c593 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521823.586199:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c593 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521823.586206:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c593 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521823.586212:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521823.586217:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c593 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521823.586224:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c593 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521823.586236:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff996fa0d5ce00) 00010000:00010000:0.0:1788521823.586239:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521823.586243:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c593 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521823.586260:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c593 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521823.586275:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c59a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521823.586281:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c59a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521823.586287:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c59a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521823.586292:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4001400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521823.586295:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c59a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521823.586301:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c59a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521823.586308:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff996f83d6d800) 00010000:00010000:0.0:1788521823.586311:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521823.586314:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c59a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521823.586319:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c59a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521823.586716:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001e00/0x1b7b50db5927c58c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b5a expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521823.586732:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c5a1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b5a expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521823.586746:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996fb19efc00) 00010000:00010000:0.0:1788521823.586748:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521823.586751:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4000800, rc 0) 00000100:00100000:0.0:1788521823.586820:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+15:11292:x1875400799090432:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 1284us (1508us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788521823.586829:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 137 00000100:00080000:1.0:1788521823.587436:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521823.590072:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521823.590419:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799090560 00000100:00100000:3.0:1788521823.590438:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799090560 00000100:00100000:2.0:1788521823.590499:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521823.590544:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 138 00000100:00100000:3.0:1788521823.590560:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc1ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+15:11292:x1875400799090560:12345-192.168.206.48@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788521823.590603:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799090688 00000100:00100000:0.0:1788521823.590613:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799090688 00000100:00100000:0.0:1788521823.590681:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:0.0:1788521823.590691:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+16:2362:x1875400799090688:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521823.590706:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521823.590729:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c5a1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b5a expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521823.590748:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996fb19efc00) 00010000:00010000:0.0:1788521823.590753:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521823.591006:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc1ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+15:11292:x1875400799090560:12345-192.168.206.48@tcp:59:lhsmtool_posix.0 Request processed in 447us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521823.591017:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 138 00000100:00100000:0.0:1788521823.593405:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+14:2362:x1875400799090688:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 2637us (2830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521823.593420:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 10 00000040:00080000:0.0:1788521824.206803:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788521824.206816:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788521824.206875:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1788521824.206884:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788521824.400324:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521824.592544:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816922368:0@lo:400:kworker.0 00000100:00100000:0.0:1788521824.592838:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521824.593033:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816922368 00000100:00100000:3.0:1788521824.593047:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816922368 00000100:00100000:3.0:1788521824.593178:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788521824.593190:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3304:x1875400816922368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521824.593865:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3304:x1875400816922368:12345-0@lo:400:kworker.0 Request processed in 669us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521824.593866:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc3ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875400816922624:0@lo:400:kworker.0 00000100:00100000:3.0:1788521824.593917:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788521824.593953:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521824.593990:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc3edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875400816922496:0@lo:400:kworker.0 00000100:00100000:1.0:1788521824.594004:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc3ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816922752:0@lo:400:kworker.0 00000100:00100000:3.0:1788521824.594048:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521824.594057:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521824.594107:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816922624 00000100:00100000:1.0:1788521824.594110:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816922496 00000100:00100000:3.0:1788521824.594115:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816922624 00000100:00100000:1.0:1788521824.594120:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816922496 00000100:00100000:1.0:1788521824.594205:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788521824.594216:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875400816922496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521824.594218:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788521824.594237:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb78a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875400816922624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521824.594295:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875400816922496:12345-0@lo:400:kworker.0 Request processed in 79us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521824.594304:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788521824.594333:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816922752 00000100:00100000:1.0:1788521824.594337:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816922752 00000100:00100000:1.0:1788521824.594369:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788521824.594376:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb78a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816922752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521824.595346:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb78a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816922752:12345-0@lo:400:kworker.0 Request processed in 962us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521824.595357:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788521824.595436:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc3ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816922752:0@lo:400:kworker.0 00000100:00100000:0.0:1788521824.600016:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816922368:0@lo:400:kworker.0 00000100:00100000:0.0:1788521824.600067:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb78a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875400816922880:0@lo:400:kworker.0 00000100:00100000:0.0:1788521824.600303:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521824.602069:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc3ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875400816922624:0@lo:400:kworker.0 00000100:00100000:3.0:1788521824.602518:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb78a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875400816922624:12345-0@lo:400:kworker.0 Request processed in 8285us (8563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521824.602530:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788521824.602559:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816922880 00000100:00100000:3.0:1788521824.602566:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816922880 00000100:00100000:0.0:1788521824.604954:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788521824.604978:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc1aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875400816922880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521824.605077:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc1aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875400816922880:12345-0@lo:400:kworker.0 Request processed in 110us (4773us total) trans 0 rc 0/0 00000100:00080000:3.0:1788521824.607410:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788521824.607423:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521824.607505:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc3edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875400816922496:0@lo:400:kworker.0 00000100:00100000:3.0:1788521824.607522:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb78a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816923008:0@lo:400:kworker.0 00000100:00100000:3.0:1788521824.607755:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521824.608062:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816923008 00000100:00100000:3.0:1788521824.608071:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816923008 00000100:00100000:3.0:1788521824.608138:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788521824.608186:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb46d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816923008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521824.608250:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb46d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816923008:12345-0@lo:400:kworker.0 Request processed in 69us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521824.608341:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788521824.608981:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb78a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875400816922880:0@lo:400:kworker.0 00000100:00080000:2.0:1788521824.609520:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788521824.610328:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788521824.610415:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb78a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816923008:0@lo:400:kworker.0 00000100:00100000:0.0:1788521825.106765:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788521825.106795:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc1aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816923136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521825.106895:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521825.106974:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816923136 00000100:00100000:0.0:1788521825.106983:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816923136 00000100:00100000:0.0:1788521825.107040:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788521825.107051:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816923136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788521825.107111:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521825.107200:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816923136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521825.107208:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788521825.107393:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc1aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816923136:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788521825.422967:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521825.810683:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521825.812645:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799090816 00000100:00100000:0.0:1788521825.812665:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799090816 00000100:00100000:1.0:1788521825.814999:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 139 00000100:00100000:1.0:1788521825.815017:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb78a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+14:11334:x1875400799090816:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1788521825.815045:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521825.815074:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c5af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00b61 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521825.815189:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927c5b6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521825.815209:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927c5b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521825.815223:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927c5b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521825.815241:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4200/0x1b7b50db5927c5bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521825.815248:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4200/0x1b7b50db5927c5bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521825.815254:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4200/0x1b7b50db5927c5bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521825.815558:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927c5b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521825.815567:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927c5b6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521825.815587:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927c5b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521825.815593:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d4e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521825.815598:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927c5b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521825.815606:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927c5b6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521825.815621:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:1.0:1788521825.815624:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521825.815630:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927c5b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521825.815637:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927c5b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521825.815651:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4200/0x1b7b50db5927c5bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521825.815657:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4200/0x1b7b50db5927c5bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521825.815664:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4200/0x1b7b50db5927c5bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521825.815669:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d4200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521825.815672:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4200/0x1b7b50db5927c5bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521825.815689:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4200/0x1b7b50db5927c5bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521825.815698:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff996fa0d5ca00) 00010000:00010000:1.0:1788521825.815700:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521825.815704:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4200/0x1b7b50db5927c5bd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521825.815709:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4200/0x1b7b50db5927c5bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521825.815748:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c5af lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b61 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521825.815760:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:1.0:1788521825.815763:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521825.815767:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c5af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b61 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521825.815779:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d5800, rc 0) 00000100:00100000:1.0:1788521825.815867:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb78a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+14:11334:x1875400799090816:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 854us (5199us total) trans 0 rc 301/301 00000100:00100000:1.0:1788521825.815875:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 139 00000100:00080000:2.0:1788521825.816178:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521825.826352:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521825.827824:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799091072 00000100:00100000:0.0:1788521825.827846:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799091072 00000100:00100000:0.0:1788521825.827936:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 140 00000100:00100000:0.0:1788521825.827950:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadb3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+14:11334:x1875400799091072:12345-192.168.206.48@tcp:36:lfs.0 00010000:00010000:0.0:1788521825.828026:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521825.828060:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927bf2d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0099a expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521825.828081:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:0.0:1788521825.828088:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788521825.828378:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c5c4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521825.828396:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c585 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b53 expref: 5 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521825.828407:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c5c4 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521825.828608:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c585 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b53 expref: 5 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521825.828635:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c585 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b53 expref: 5 pid: 5834 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521825.828651:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc1aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875400816923264:192.168.206.48@tcp:104: 00000100:00100000:0.0:1788521825.828797:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86989900 going to sleep for 11 seconds 00000100:00100000:2.0:1788521825.834112:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521825.834264:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc1aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875400816923264:192.168.206.48@tcp:104: 00010000:00010000:0.0:1788521825.834306:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c5c4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521825.834405:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799091200 00000100:00100000:3.0:1788521825.834416:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799091200 00010000:00010000:3.0:1788521825.834497:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c585 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b53 expref: 6 pid: 5834 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521825.834544:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 61 00000100:00100000:3.0:1788521825.834556:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e406c42-03a1-40c3-937c-c3b114a3dde8+6:2364:x1875400799091200:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521825.834574:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521825.834582:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c585 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b53 expref: 6 pid: 5834 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521825.834605:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c585 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b53 expref: 6 pid: 5834 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521825.834632:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c585 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b53 expref: 6 pid: 5834 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521825.834651:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:3.0:1788521825.834656:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c5c4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521825.834668:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c5c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521825.834677:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c5c4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521825.834705:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521825.834785:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2364:x1875400799091200:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 231us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521825.834794:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 61 00010000:00010000:3.0:1788521825.835070:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c5c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521825.835079:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c5c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521825.835108:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c5cb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521825.835119:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c5cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521825.835128:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c5cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788521825.836009:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1788521825.837773:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788521825.837799:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c5c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521825.837812:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c5c4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521825.837821:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c5c4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521825.837828:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4001400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521825.837833:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c5c4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521825.837854:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c5c4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521825.837883:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:3.0:1788521825.837887:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521825.837893:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c5c4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521825.837900:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c5c4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788521825.837927:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f25133a9 reply state 000000008ddc3b4b transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c5cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521825.837938:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788521825.838073:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadb3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+15:11334:x1875400799091072:12345-192.168.206.48@tcp:36:lfs.0 Request processed in 10120us (11724us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788521825.838083:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 140 00010000:00010000:3.0:1788521825.842660:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c5cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521825.842682:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c5cb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521825.842691:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c5cb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521825.842697:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80031a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521825.842702:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c5cb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521825.842711:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c5cb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521825.842749:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff996f8687e000) 00010000:00010000:3.0:1788521825.842752:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521825.842758:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c5cb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521825.842765:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c5cb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521825.978022:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521825.980382:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799091328 00000100:00100000:1.0:1788521825.980405:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799091328 00000100:00100000:1.0:1788521825.980519:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 141 00000100:00100000:1.0:1788521825.980532:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc1aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+14:11342:x1875400799091328:12345-192.168.206.48@tcp:101:lctl.0 00010000:00010000:1.0:1788521825.980584:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521825.980618:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c5d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00b68 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521825.980706:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4200/0x1b7b50db5927c5d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521825.980724:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4200/0x1b7b50db5927c5d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521825.980740:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4200/0x1b7b50db5927c5d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521825.980786:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788521825.980790:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521825.980819:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4200/0x1b7b50db5927c5d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521825.980847:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c5d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b68 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521825.980874:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4200/0x1b7b50db5927c5d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b68 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521825.980884:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fa0d5ca00) 00010000:00010000:1.0:1788521825.980887:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788521825.980891:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d4200, rc 0) 00000100:00100000:1.0:1788521825.980974:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc1aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+15:11342:x1875400799091328:12345-192.168.206.48@tcp:101:lctl.0 Request processed in 445us (2962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521825.980982:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 141 00000100:00100000:2.0:1788521826.046757:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521826.046894:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799091456 00000100:00100000:0.0:1788521826.046906:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799091456 00000100:00100000:0.0:1788521826.046978:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 142 00000100:00100000:0.0:1788521826.046989:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+15:11348:x1875400799091456:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:0.0:1788521826.047014:0:10083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521826.047038:0:10083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001200/0x1b7b50db5927c5e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00b6f expref: -99 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.047116:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c5e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.047134:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c5e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.047197:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c5e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.047217:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c5ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.047224:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c5ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.047230:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c5ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.047367:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001a00/0x1b7b50db5927c5f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.047376:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001a00/0x1b7b50db5927c5f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.047382:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001a00/0x1b7b50db5927c5f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521826.047415:0:10083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788521826.047419:0:10083:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788521826.047527:0:10083:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001a00/0x1b7b50db5927c5f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.047543:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c5e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.047550:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c5e7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.047557:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c5e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.047563:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4001000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521826.047568:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c5e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.047575:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c5e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.047589:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fa0d5ca00) 00010000:00010000:0.0:1788521826.047600:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521826.047608:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c5e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.047615:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c5e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.047631:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c5ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.047637:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c5ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.047643:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c5ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.047648:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521826.047651:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c5ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.047658:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c5ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.047665:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff996f83d6d800) 00010000:00010000:0.0:1788521826.047668:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521826.047672:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c5ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.047678:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c5ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.047714:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001200/0x1b7b50db5927c5e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b6f expref: 17 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.047742:0:10083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001a00/0x1b7b50db5927c5f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b6f expref: 16 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.047749:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:0.0:1788521826.047752:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788521826.047754:0:10083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4001a00, rc 0) 00000100:00100000:0.0:1788521826.047834:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+16:11348:x1875400799091456:12345-192.168.206.48@tcp:101:bash.0 Request processed in 847us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521826.047842:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 142 00000100:00100000:0.0:1788521826.054282:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521826.054391:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799091712 00000100:00100000:1.0:1788521826.054409:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799091712 00000100:00100000:1.0:1788521826.054585:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 143 00000100:00100000:1.0:1788521826.054598:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad7a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+16:11348:x1875400799091712:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:1.0:1788521826.054624:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521826.054651:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927c5fc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00b76 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.055044:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c603 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.055064:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c603 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.055092:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c603 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.058714:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927c60a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.058737:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927c60a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.058750:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927c60a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788521826.059422:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788521826.059642:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001200/0x1b7b50db5927c611 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.059655:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001200/0x1b7b50db5927c611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.059666:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001200/0x1b7b50db5927c611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.059702:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c603 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.059710:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c603 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.059717:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c603 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.059736:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521826.059741:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c603 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.059749:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c603 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.059762:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:0.0:1788521826.059765:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521826.059770:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c603 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.059777:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c603 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788521826.059793:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043a965cc reply state 000000000ead4596 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927c60a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521826.059802:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788521826.059838:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927c5fc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b76 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.059854:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001200/0x1b7b50db5927c611 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b76 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.059861:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f83d6d800) 00010000:00010000:0.0:1788521826.059864:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788521826.059866:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4001200, rc 0) 00000100:00100000:0.0:1788521826.059949:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad7a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+19:11348:x1875400799091712:12345-192.168.206.48@tcp:101:bash.0 Request processed in 5354us (5676us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788521826.059965:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 143 00010000:00010000:0.0:1788521826.062858:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927c60a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.062875:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927c60a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.062883:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927c60a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.062889:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521826.062894:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927c60a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.062902:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927c60a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.062920:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff996fa0d5cc00) 00010000:00010000:0.0:1788521826.062923:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521826.062928:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927c60a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.062934:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927c60a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521826.066568:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521826.068296:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799091840 00000100:00100000:2.0:1788521826.068319:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799091840 00000100:00100000:2.0:1788521826.068429:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 47 00000100:00100000:2.0:1788521826.068457:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2364:x1875400799091840:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:2.0:1788521826.068490:0:11097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521826.068520:0:11097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002792d343/0x1b7b50db5927c61f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00b7d expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788521826.068552:0:11097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788521826.068579:0:11097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=326s v=(0 0) 00010000:00010000:2.0:1788521826.068585:0:11097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521826.068597:0:11097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002792d343/0x1b7b50db5927c61f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b7d expref: 6 pid: 11097 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521826.068621:0:11097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002792d343/0x1b7b50db5927c61f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b7d expref: 6 pid: 11097 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521826.068637:0:11097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490ac00, rc 0) 00000100:00080000:3.0:1788521826.068770:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521826.069121:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2364:x1875400799091840:12345-192.168.206.48@tcp:101:bash.0 Request processed in 667us (2559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521826.069131:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 47 00000100:00100000:1.0:1788521826.074425:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521826.074588:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799091968 00000100:00100000:2.0:1788521826.074622:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799091968 00000100:00100000:2.0:1788521826.074826:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 48 00000100:00100000:2.0:1788521826.074840:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb78a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+6:11348:x1875400799091968:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:2.0:1788521826.074865:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521826.074900:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c626 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00b84 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521826.074943:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002792d343/0x1b7b50db5927c61f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b7d expref: 7 pid: 11097 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521826.074954:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521826.074959:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521826.074965:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c626 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b84 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521826.075008:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002792d343/0x1b7b50db5927c61f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b7d expref: 7 pid: 11097 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521826.075033:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002792d343/0x1b7b50db5927c61f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b7d expref: 7 pid: 11097 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521826.075050:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb4a64a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1875400816923392:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788521826.075224:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fbc3c46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521826.077943:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb4a64a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1875400816923392:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788521826.077982:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c626 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b84 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521826.078028:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490aa00, rc 0) 00000100:00100000:2.0:1788521826.078090:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb78a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+7:11348:x1875400799091968:12345-192.168.206.48@tcp:101:bash.0 Request processed in 3253us (3674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521826.078100:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 48 00000100:00100000:0.0:1788521826.078827:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521826.078898:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799092096 00000100:00100000:1.0:1788521826.078906:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799092096 00010000:00010000:1.0:1788521826.078939:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002792d343/0x1b7b50db5927c61f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b7d expref: 7 pid: 11097 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521826.078987:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 62 00000100:00100000:1.0:1788521826.078997:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2363:x1875400799092096:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521826.079011:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521826.079031:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002792d343/0x1b7b50db5927c61f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b7d expref: 7 pid: 11097 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.079051:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002792d343/0x1b7b50db5927c61f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b7d expref: 7 pid: 11097 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.079074:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002792d343/0x1b7b50db5927c61f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b7d expref: 7 pid: 11097 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.079088:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521826.079093:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521826.079101:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c626 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b84 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.079110:0:7633:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c626 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b84 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.079194:0:7633:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c626 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b84 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521826.079208:0:7633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc3edf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7633:1875400816923520:192.168.206.48@tcp:105: 00000100:00100000:1.0:1788521826.079283:0:7633:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f91285d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521826.087361:0:7633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc3edf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7633:1875400816923520:192.168.206.48@tcp:105: 00010000:00010000:3.0:1788521826.087399:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521826.087503:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2363:x1875400799092096:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 8507us (8677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521826.087516:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 62 00000100:00100000:1.0:1788521826.087664:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521826.087736:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799092352 00000100:00100000:3.0:1788521826.087746:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799092352 00000100:00100000:3.0:1788521826.087808:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:3.0:1788521826.087819:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+18:11348:x1875400799092352:12345-192.168.206.48@tcp:35:bash.0 00000100:00100000:3.0:1788521826.088305:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+19:11348:x1875400799092352:12345-192.168.206.48@tcp:35:bash.0 Request processed in 486us (650us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788521826.088314:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 36 00000001:00080000:2.0:1788521826.191724:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000001:00080000:2.0:1788521826.191752:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967418 is committed 00000100:00100000:1.0:1788521826.212571:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521826.212751:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799092608 00000100:00100000:0.0:1788521826.212765:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799092608 00000100:00100000:0.0:1788521826.212840:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 144 00000100:00100000:0.0:1788521826.212883:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+15:11358:x1875400799092608:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1788521826.212916:0:10083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521826.212942:0:10083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c62d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00b8b expref: -99 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521826.213061:0:10083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788521826.213415:0:10083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c62d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b8b expref: 17 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.213442:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fa0d5ca00) 00010000:00010000:0.0:1788521826.213446:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788521826.213453:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c62d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b8b expref: 17 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.213478:0:10083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4000a00, rc 0) 00000100:00100000:0.0:1788521826.213562:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+16:11358:x1875400799092608:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 681us (1006us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1788521826.213570:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 144 00000100:00100000:1.0:1788521826.220724:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521826.220876:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799092864 00000100:00100000:3.0:1788521826.220899:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799092864 00000100:00100000:3.0:1788521826.220981:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 37 00000100:00100000:3.0:1788521826.220993:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+16:11358:x1875400799092864:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:3.0:1788521826.221351:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+17:11358:x1875400799092864:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 359us (640us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788521826.221377:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 37 00000100:00100000:2.0:1788521826.315987:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521826.316262:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799092992 00000100:00100000:3.0:1788521826.316276:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799092992 00000100:00100000:3.0:1788521826.316360:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 145 00000100:00100000:3.0:1788521826.316373:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+17:11364:x1875400799092992:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521826.316406:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521826.316446:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c63b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00b92 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.316535:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c642 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.316554:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c642 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.316568:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c642 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521826.316614:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788521826.316619:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788521826.316643:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c642 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.316673:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c63b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b92 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.316708:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c642 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b92 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.316741:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:3.0:1788521826.316744:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788521826.316749:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f80030400, rc 0) 00000100:00100000:3.0:1788521826.316831:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+18:11364:x1875400799092992:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 459us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521826.316838:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 145 00000100:00100000:1.0:1788521826.324928:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521826.325180:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799093248 00000100:00100000:0.0:1788521826.325193:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799093248 00000100:00100000:0.0:1788521826.325324:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 146 00000100:00100000:0.0:1788521826.325338:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+18:11364:x1875400799093248:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1788521826.325366:0:10083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521826.325404:0:10083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c649 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00b99 expref: -99 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.325549:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927c650 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.325584:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927c650 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.325599:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927c650 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521826.325615:0:10083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788521826.325786:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c649 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b99 expref: 21 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.325809:0:10083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927c650 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b99 expref: 20 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.325819:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f83d6d800) 00010000:00010000:0.0:1788521826.325822:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788521826.325826:0:10083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4000200, rc 0) 00000100:00100000:0.0:1788521826.325975:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+20:11364:x1875400799093248:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 640us (1061us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1788521826.325983:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 146 00000100:00100000:1.0:1788521826.342664:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521826.343909:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521826.345196:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799093632 00000100:00100000:3.0:1788521826.345218:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799093632 00000100:00100000:3.0:1788521826.345315:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 147 00000100:00100000:3.0:1788521826.345328:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+20:11364:x1875400799093632:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521826.345359:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521826.345385:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c65e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00ba0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.345536:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c665 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.345555:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c665 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.345569:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c665 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521826.345583:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788521826.345742:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c65e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ba0 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.345788:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c665 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ba0 expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.345797:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f83d6d800) 00010000:00010000:3.0:1788521826.345801:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788521826.345804:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f80030600, rc 0) 00000100:00100000:3.0:1788521826.345896:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+22:11364:x1875400799093632:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 570us (1996us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788521826.345905:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 147 00000100:00100000:0.0:1788521826.349275:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799093376 00000100:00100000:0.0:1788521826.349299:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799093376 00000100:00100000:0.0:1788521826.349395:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:0.0:1788521826.349407:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+22:2362:x1875400799093376:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521826.349429:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521826.349482:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927c650 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b99 expref: 22 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.349528:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f83d6d800) 00010000:00010000:0.0:1788521826.349534:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521826.349616:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+21:2362:x1875400799093376:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 211us (6967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521826.349624:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:2.0:1788521826.376029:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521826.376241:0:12322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799093760 00000100:00100000:1.0:1788521826.376255:0:12322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799093760 00000100:00100000:1.0:1788521826.376332:0:12322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 49 00000100:00100000:1.0:1788521826.376344:0:12322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2364:x1875400799093760:12345-192.168.206.48@tcp:1:lfs.0 00010000:00010000:1.0:1788521826.376402:0:12322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b78dd842/0x1b7b50db5927c673 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.376427:0:12322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c626 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b84 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.376449:0:12322:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521826.376454:0:12322:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788521826.376459:0:12322:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b78dd842/0x1b7b50db5927c673 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.376502:0:12322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c626 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b84 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.376526:0:12322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c626 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b84 expref: 6 pid: 6690 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521826.376569:0:12322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f42300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12322:1875400816923648:192.168.206.48@tcp:104: 00000100:00100000:1.0:1788521826.376689:0:12322:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fad804900 going to sleep for 11 seconds 00000100:00100000:1.0:1788521826.388852:0:12322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f42300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12322:1875400816923648:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788521826.388909:0:12322:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b78dd842/0x1b7b50db5927c673 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521826.389307:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521826.390507:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799093888 00000100:00100000:2.0:1788521826.390523:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799093888 00002000:00100000:2.0:1788521826.390603:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff996fad7a9500 x1875400799093888/t0(0) o4->4bd13e8f-aac9-42ad-8625-a542705d6920@192.168.206.48@tcp:72/0 lens 504/0 e 0 to 0 dl 1788521837 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788521826.390616:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff996fad7a9500 with x1875400799093888 ext(0->12) 00010000:00010000:2.0:1788521826.390627:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c626 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b84 expref: 7 pid: 6690 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521826.390654:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c626 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b84 expref: 7 pid: 6690 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788521826.390663:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff996fad7a9500 00000100:00100000:2.0:1788521826.392681:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:2.0:1788521826.392724:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2363:x1875400799093888:12345-192.168.206.48@tcp:4:lfs.0 00000100:00100000:2.0:1788521826.399869:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+9:2363:x1875400799093888:12345-192.168.206.48@tcp:4:lfs.0 Request processed in 7155us (10561us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788521826.399893:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 2 00002000:00100000:2.0:1788521826.399912:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff996fad7a9500 x1875400799093888/t4294967305(0) o4->4bd13e8f-aac9-42ad-8625-a542705d6920@192.168.206.48@tcp:72/0 lens 504/448 e 0 to 0 dl 1788521837 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788521826.399923:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff996fad7a9500 with x1875400799093888 ext(0->12) 00010000:00010000:2.0:1788521826.399944:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c626 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b84 expref: 9 pid: 6690 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521826.399972:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c626 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b84 expref: 9 pid: 6690 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788521826.399980:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff996fad7a9500 00000100:00100000:3.0:1788521826.402759:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521826.402859:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799094016 00000100:00100000:2.0:1788521826.402873:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799094016 00010000:00010000:2.0:1788521826.402918:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c626 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b84 expref: 9 pid: 6690 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521826.402977:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 63 00000100:00100000:2.0:1788521826.402987:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadb3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+9:2364:x1875400799094016:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521826.403005:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788521826.403028:0:5819:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788521826.403031:0:5819:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788521826 00002000:00010000:2.0:1788521826.403034:0:5819:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788521826 00002000:00010000:2.0:1788521826.403035:0:5819:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788521826 00010000:00010000:2.0:1788521826.403042:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c626 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b84 expref: 9 pid: 6690 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521826.403091:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c626 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b84 expref: 9 pid: 6690 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521826.403114:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c626 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b84 expref: 9 pid: 6690 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521826.403131:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788521826.403135:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788521826.403180:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b78dd842/0x1b7b50db5927c673 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521826.403191:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b78dd842/0x1b7b50db5927c673 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521826.403218:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521826.403287:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadb3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+8:2364:x1875400799094016:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 300us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521826.403294:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 63 00010000:00010000:1.0:1788521826.403401:0:12322:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b78dd842/0x1b7b50db5927c673 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.403429:0:12322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b78dd842/0x1b7b50db5927c673 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.403493:0:12322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b78dd842/0x1b7b50db5927c673 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.403505:0:12322:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b78dd842/0x1b7b50db5927c673 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.403514:0:12322:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b78dd842/0x1b7b50db5927c673 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.403520:0:12322:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5600 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:1.0:1788521826.403525:0:12322:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b78dd842/0x1b7b50db5927c673 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.403555:0:12322:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b78dd842/0x1b7b50db5927c673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.403574:0:12322:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b78dd842/0x1b7b50db5927c673 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.403582:0:12322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b78dd842/0x1b7b50db5927c673 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521826.403686:0:12322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2364:x1875400799093760:12345-192.168.206.48@tcp:1:lfs.0 Request processed in 27342us (27667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521826.403696:0:12322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 49 00000100:00100000:2.0:1788521826.408063:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521826.408559:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799094272 00000100:00100000:0.0:1788521826.408579:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799094272 00000100:00100000:0.0:1788521826.408661:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 38 00000100:00100000:0.0:1788521826.408675:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f97fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+21:11364:x1875400799094272:12345-192.168.206.48@tcp:35:lfs.0 00000004:00010000:0.0:1788521826.410029:0:5837:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c665 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ba0 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788521826.411512:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1788521826.411564:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1788521826.425005:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1788521826.425784:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c67a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.425814:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001200/0x1b7b50db5927c611 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b76 expref: 25 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.425826:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c67a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.425882:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001200/0x1b7b50db5927c611 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b76 expref: 25 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.427259:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001200/0x1b7b50db5927c611 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b76 expref: 25 pid: 5834 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521826.427308:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f42300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1875400816923776:192.168.206.48@tcp:104: 00000100:00100000:1.0:1788521826.427441:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fad8049c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521826.435087:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f42300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1875400816923776:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788521826.435186:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c67a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521826.440085:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521826.440320:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799094400 00000100:00100000:3.0:1788521826.440338:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799094400 00010000:00010000:3.0:1788521826.440408:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001200/0x1b7b50db5927c611 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b76 expref: 26 pid: 5834 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521826.440484:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 64 00000100:00100000:3.0:1788521826.440497:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f856e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+26:2363:x1875400799094400:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521826.440518:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521826.440525:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001200/0x1b7b50db5927c611 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b76 expref: 26 pid: 5834 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.440575:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001200/0x1b7b50db5927c611 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b76 expref: 26 pid: 5834 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.440606:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001200/0x1b7b50db5927c611 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b76 expref: 26 pid: 5834 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.440629:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f83d6d800) 00010000:00010000:3.0:1788521826.440636:0:7633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c67a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.440647:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c67a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.440657:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c67a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.440705:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521826.440788:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f856e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+25:2363:x1875400799094400:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 293us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521826.440796:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 64 00010000:00010000:2.0:1788521826.441471:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c67a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521826.441483:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c67a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788521826.441651:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788521826.442766:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1788521826.442937:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb4a67b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1875400816923904:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788521826.443016:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521826.443070:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fbc3c4780 going to sleep for 11 seconds 00000100:00100000:1.0:1788521826.444304:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816923904 00000100:00100000:1.0:1788521826.444320:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816923904 00000100:00100000:1.0:1788521826.444421:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788521826.444443:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1875400816923904:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788521826.444596:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1875400816923904:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 165us (1578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521826.444604:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788521826.444717:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521826.444995:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb4a67b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1875400816923904:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788521826.445876:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1788521826.446741:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb4a67b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1875400816924032:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788521826.446824:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521826.446870:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fbc3c4180 going to sleep for 11 seconds 00010000:00010000:1.0:1788521826.446956:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521826.447123:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816924032 00000100:00100000:0.0:1788521826.447133:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816924032 00000100:00100000:0.0:1788521826.447222:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788521826.447234:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5837:x1875400816924032:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788521826.448382:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5837:x1875400816924032:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 1141us (1548us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788521826.448396:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788521826.448605:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb4a67b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1875400816924032:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788521826.448704:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1788521826.448773:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c67a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521826.448784:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c67a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521826.448792:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c67a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521826.448797:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521826.448802:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c67a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521826.448810:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c67a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521826.448829:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f83d6d800) 00010000:00010000:2.0:1788521826.448832:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788521826.448856:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c67a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521826.448863:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927c67a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788521826.449873:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788521826.450030:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1788521826.450042:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 326434899323ns, next at 327434896643ns, rc = 0 00000001:00080000:2.0:1788521826.450051:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1788521826.450121:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f83d6d800) 00010000:00010000:2.0:1788521826.450126:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788521826.450136:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c665 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ba0 expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521826.450343:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f97fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+28:11364:x1875400799094272:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 41670us (42287us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1788521826.450353:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 38 00000020:00080000:2.0:1788521826.450359:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788521826.456875:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521826.457057:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799094528 00000100:00100000:3.0:1788521826.457070:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799094528 00000100:00100000:3.0:1788521826.457551:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 148 00000100:00100000:3.0:1788521826.457565:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+28:11364:x1875400799094528:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521826.457599:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521826.457630:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c681 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00ba7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.457733:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c681 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ba7 expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.457752:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c681 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ba7 expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.457776:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687e000) 00010000:00010000:3.0:1788521826.457779:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788521826.457784:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f80031a00, rc 0) 00000100:00100000:3.0:1788521826.457866:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+29:11364:x1875400799094528:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 304us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521826.457873:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 148 00000100:00100000:1.0:1788521826.461719:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521826.461809:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799094784 00000100:00100000:2.0:1788521826.461823:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799094784 00000100:00100000:2.0:1788521826.461918:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 39 00000100:00100000:2.0:1788521826.461931:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+29:11364:x1875400799094784:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:2.0:1788521826.462294:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+30:11364:x1875400799094784:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 365us (589us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1788521826.462302:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 39 00000100:00100000:2.0:1788521826.565204:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521826.565751:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799095040 00000100:00100000:3.0:1788521826.565765:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799095040 00000100:00100000:3.0:1788521826.565846:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 149 00000100:00100000:3.0:1788521826.565859:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+30:11374:x1875400799095040:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521826.565892:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521826.565921:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c688 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00bae expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521826.566036:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788521826.566242:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c688 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bae expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.566261:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fa0d5ca00) 00010000:00010000:3.0:1788521826.566264:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788521826.566289:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c688 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bae expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.566307:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f80030600, rc 0) 00000100:00100000:3.0:1788521826.566392:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+31:11374:x1875400799095040:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 535us (1202us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1788521826.566402:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 149 00000100:00100000:0.0:1788521826.582005:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521826.582055:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521826.582087:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521826.582202:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521826.582245:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799095424 00000100:00100000:0.0:1788521826.582259:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799095424 00000100:00100000:0.0:1788521826.582323:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799095552 00000100:00100000:0.0:1788521826.582327:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799095552 00000100:00100000:0.0:1788521826.582353:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 136 00000100:00100000:0.0:1788521826.582365:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2362:x1875400799095424:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521826.582486:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2362:x1875400799095424:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 123us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521826.582495:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 136 00000100:00100000:0.0:1788521826.582522:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 150 00000100:00100000:0.0:1788521826.582528:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad7a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+31:11374:x1875400799095552:12345-192.168.206.48@tcp:34:lfs.0 00010000:00010000:0.0:1788521826.582609:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c696 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.582629:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c696 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.582644:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c696 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.582661:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c69d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.582669:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c69d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.582676:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c69d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.582976:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927c6a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.582987:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927c6a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.582994:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927c6a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788521826.583045:0:10083:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927c6a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.583059:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c696 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.583066:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c696 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.583073:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c696 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.583079:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521826.583084:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c696 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.583093:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c696 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.583106:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:0.0:1788521826.583110:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521826.583116:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c696 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.583131:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c696 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.583181:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c69d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.583188:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c69d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.583193:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c69d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.583197:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521826.583200:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c69d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.583206:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c69d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.583213:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff996f83d6dd00) 00010000:00010000:0.0:1788521826.583216:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521826.583220:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c69d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.583225:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c69d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.583240:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927c6a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.583246:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927c6a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.583259:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927c6a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.583265:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4001800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521826.583269:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927c6a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.583276:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927c6a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.583284:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687e000) 00010000:00010000:0.0:1788521826.583287:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521826.583290:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927c6a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.583296:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927c6a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521826.583345:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad7a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+31:11374:x1875400799095552:12345-192.168.206.48@tcp:34:lfs.0 Request processed in 815us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521826.583354:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 150 00000100:00100000:1.0:1788521826.584006:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799095168 00000100:00100000:1.0:1788521826.584016:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799095168 00000100:00100000:1.0:1788521826.584080:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 285 00000100:00100000:1.0:1788521826.584090:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+13:2362:x1875400799095168:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521826.584188:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+13:2362:x1875400799095168:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 100us (2196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521826.584196:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 285 00000100:00100000:2.0:1788521826.584394:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799095296 00000100:00100000:2.0:1788521826.584410:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799095296 00000100:00100000:2.0:1788521826.584488:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 80 00000100:00100000:2.0:1788521826.584497:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2362:x1875400799095296:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521826.584530:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2362:x1875400799095296:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 36us (2442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521826.584537:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 80 00000100:00080000:3.0:1788521826.584648:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521826.586869:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521826.587280:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799095808 00000100:00100000:2.0:1788521826.587292:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799095808 00000100:00100000:2.0:1788521826.587358:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 40 00000100:00100000:2.0:1788521826.587369:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadb3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+31:11374:x1875400799095808:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:2.0:1788521826.587759:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadb3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+32:11374:x1875400799095808:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 390us (914us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788521826.587768:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 40 00000100:00100000:3.0:1788521826.621216:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521826.622216:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799096064 00000100:00100000:0.0:1788521826.622232:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799096064 00000100:00100000:0.0:1788521826.622394:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 151 00000100:00100000:0.0:1788521826.622408:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadb3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+32:11377:x1875400799096064:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1788521826.622452:0:10083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521826.622482:0:10083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927c6ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00bb5 expref: -99 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.622602:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c6b2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.622622:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c6b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.622636:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c6b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.622652:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c6b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.622659:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c6b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.622666:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c6b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.622999:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001c00/0x1b7b50db5927c6c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.623009:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001c00/0x1b7b50db5927c6c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.623016:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001c00/0x1b7b50db5927c6c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521826.623028:0:10083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788521826.623203:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c6b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.623226:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c6b2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.623235:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c6b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.623242:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521826.623247:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c6b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.623259:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c6b2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.623273:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:0.0:1788521826.623277:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521826.623283:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c6b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.623290:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c6b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.623304:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c6b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.623310:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c6b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.625952:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c6b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.625978:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521826.626009:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c6b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.626021:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c6b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.626044:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff996f83d6dd00) 00010000:00010000:0.0:1788521826.626048:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521826.626054:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c6b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521826.626062:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c6b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.631089:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927c6ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bb5 expref: 35 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.631131:0:10083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001c00/0x1b7b50db5927c6c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bb5 expref: 34 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.631441:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687e000) 00010000:00010000:1.0:1788521826.631956:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521826.631963:0:10083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4001c00, rc 0) 00000100:00100000:1.0:1788521826.632124:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadb3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+34:11377:x1875400799096064:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 9716us (10917us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1788521826.632136:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 151 00000100:00100000:3.0:1788521826.638806:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb4a64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816924160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521826.638912:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521826.638990:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816924160 00000100:00100000:2.0:1788521826.639001:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816924160 00000100:00080000:3.0:1788521826.639048:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521826.639077:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788521826.639087:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadb3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816924160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788521826.639124:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521826.639234:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadb3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816924160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521826.639241:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788521826.641599:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb4a64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816924160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521826.644699:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521826.644870:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799096192 00000100:00100000:3.0:1788521826.644961:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799096192 00000100:00100000:3.0:1788521826.645101:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 152 00000100:00100000:3.0:1788521826.645124:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+34:11377:x1875400799096192:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:3.0:1788521826.645258:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c6ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.645281:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c6ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.645298:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c6ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.645334:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c6ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.645363:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c6ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.645371:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c6ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.645379:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80030600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521826.645385:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c6ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.645395:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c6ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.645412:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687e000) 00010000:00010000:3.0:1788521826.645415:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788521826.645421:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c6ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.645427:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c6ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521826.645739:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+34:11377:x1875400799096192:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 626us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521826.645749:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 152 00000100:00100000:0.0:1788521826.649267:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521826.649386:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799096448 00000100:00100000:2.0:1788521826.649400:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799096448 00000100:00100000:2.0:1788521826.649497:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 41 00000100:00100000:2.0:1788521826.649511:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad7a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+34:11377:x1875400799096448:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:2.0:1788521826.649833:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad7a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+35:11377:x1875400799096448:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 324us (582us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788521826.649861:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 41 00000100:00100000:2.0:1788521826.875662:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521826.875734:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799096704 00000100:00100000:3.0:1788521826.875747:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799096704 00000100:00100000:3.0:1788521826.875985:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 153 00000100:00100000:3.0:1788521826.875999:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+35:11408:x1875400799096704:12345-192.168.206.48@tcp:101:cat.0 00010000:00010000:3.0:1788521826.876030:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521826.876074:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c6d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00bbc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.876240:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927c6dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.876257:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927c6dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.876270:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927c6dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521826.876282:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788521826.876454:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927c6d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bbc expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.876682:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927c6dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bbc expref: 37 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.876692:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687e000) 00010000:00010000:3.0:1788521826.876695:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521826.876699:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392da00, rc 0) 00000100:00100000:3.0:1788521826.876786:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+37:11408:x1875400799096704:12345-192.168.206.48@tcp:101:cat.0 Request processed in 790us (1138us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788521826.876795:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 153 00000100:00100000:0.0:1788521826.881570:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521826.881733:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799096960 00000100:00100000:2.0:1788521826.881746:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799096960 00000100:00100000:2.0:1788521826.881814:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 42 00000100:00100000:2.0:1788521826.881827:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad7ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+37:11408:x1875400799096960:12345-192.168.206.48@tcp:35:cat.0 00000100:00100000:2.0:1788521826.882181:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad7ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+38:11408:x1875400799096960:12345-192.168.206.48@tcp:35:cat.0 Request processed in 351us (620us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1788521826.882189:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 42 00000100:00100000:3.0:1788521826.882460:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521826.882514:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799097088 00000100:00100000:2.0:1788521826.882520:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799097088 00000100:00100000:2.0:1788521826.882576:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:2.0:1788521826.882585:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7a7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+38:2363:x1875400799097088:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521826.882602:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521826.882638:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927c6dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bbc expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521826.882661:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687e000) 00010000:00010000:2.0:1788521826.882668:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521826.882756:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7a7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+37:2363:x1875400799097088:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 171us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521826.882763:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:3.0:1788521826.946029:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521826.947290:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799097344 00000100:00100000:1.0:1788521826.947308:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799097344 00000100:00100000:1.0:1788521826.947400:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 154 00000100:00100000:1.0:1788521826.947413:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+37:11414:x1875400799097344:12345-192.168.206.48@tcp:101:dd.0 00010000:00010000:1.0:1788521826.947464:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521826.947469:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788521826.947505:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927c642 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b92 expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.947533:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:1.0:1788521826.947540:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788521826.947559:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c6ea lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00bc3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.947687:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c6f1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.947703:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001c00/0x1b7b50db5927c6c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bb5 expref: 37 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.947712:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c6f1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.947754:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001c00/0x1b7b50db5927c6c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bb5 expref: 37 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.947800:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001c00/0x1b7b50db5927c6c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bb5 expref: 37 pid: 10083 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521826.947817:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f43480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875400816924288:192.168.206.48@tcp:104: 00000100:00100000:1.0:1788521826.947944:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fad804240 going to sleep for 11 seconds 00000100:00100000:0.0:1788521826.959177:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521826.959311:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f43480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875400816924288:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788521826.959346:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c6f1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521826.959501:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799097472 00000100:00100000:3.0:1788521826.959512:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799097472 00010000:00010000:3.0:1788521826.959559:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001c00/0x1b7b50db5927c6c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bb5 expref: 38 pid: 10083 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521826.959631:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 65 00000100:00100000:3.0:1788521826.959643:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad7a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+38:2363:x1875400799097472:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521826.959662:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521826.959670:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001c00/0x1b7b50db5927c6c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bb5 expref: 38 pid: 10083 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.959692:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001c00/0x1b7b50db5927c6c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bb5 expref: 38 pid: 10083 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.959719:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001c00/0x1b7b50db5927c6c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bb5 expref: 38 pid: 10083 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.959737:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687e000) 00010000:00010000:3.0:1788521826.959743:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c6f1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.959754:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c6f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.959764:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c6f1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.959802:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521826.959869:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad7a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+37:2363:x1875400799097472:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 228us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521826.959877:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 65 00010000:00010000:2.0:1788521826.960062:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c6f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521826.960072:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c6f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521826.960104:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788521826.960317:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c6ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bc3 expref: 39 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521826.960338:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c6f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bc3 expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521826.960346:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687e000) 00010000:00010000:2.0:1788521826.960350:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788521826.960353:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d5200, rc 0) 00000100:00100000:2.0:1788521826.960383:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+38:11414:x1875400799097344:12345-192.168.206.48@tcp:101:dd.0 Request processed in 12974us (14370us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788521826.960390:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 154 00000100:00100000:0.0:1788521826.963323:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521826.963441:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799097728 00000100:00100000:1.0:1788521826.963455:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799097728 00000100:00100000:1.0:1788521826.963532:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 155 00000100:00100000:1.0:1788521826.963544:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+37:11414:x1875400799097728:12345-192.168.206.48@tcp:36:dd.0 00010000:00010000:1.0:1788521826.963903:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c6ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.963926:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c6ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521826.963942:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c6ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788521826.964006:0:10083:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1788521826.964033:0:10083:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001fde76db reply state 00000000f29f5e91 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c6ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521826.964043:0:10083:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788521826.964212:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+40:11414:x1875400799097728:12345-192.168.206.48@tcp:36:dd.0 Request processed in 668us (916us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1788521826.964221:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 155 00000020:00080000:1.0:1788521826.964227:0:10083:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788521826.971715:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c6ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.971756:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c6ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.971766:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c6ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.971773:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d4000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521826.971778:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c6ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.971787:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c6ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.971809:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687e000) 00010000:00010000:3.0:1788521826.971813:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521826.971819:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c6ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521826.971826:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c6ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521827.282781:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521827.283755:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799097856 00000100:00100000:3.0:1788521827.283770:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799097856 00000100:00100000:3.0:1788521827.283889:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 156 00000100:00100000:3.0:1788521827.283905:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+39:11428:x1875400799097856:12345-192.168.206.48@tcp:101:stat.0 00010000:00010000:3.0:1788521827.283936:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521827.283964:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c706 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00bca expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.284046:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c70d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.284079:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c70d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.284096:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c70d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.284668:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c714 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.284678:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.284686:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788521827.284822:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788521827.285015:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c71b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.285030:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c6f1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bc3 expref: 40 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.285039:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c71b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.285087:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c6f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bc3 expref: 40 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.285353:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c6f1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bc3 expref: 40 pid: 5834 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521827.285388:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1875400816924416:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788521827.286212:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fbc3d6540 going to sleep for 11 seconds 00000100:00100000:3.0:1788521827.290056:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1875400816924416:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788521827.290113:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c71b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521827.290277:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521827.290637:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799098112 00000100:00100000:3.0:1788521827.290647:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799098112 00000100:00100000:3.0:1788521827.290718:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 43 00000100:00100000:3.0:1788521827.290730:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad7aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+41:5597:x1875400799098112:12345-192.168.206.48@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788521827.293120:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad7aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+42:5597:x1875400799098112:12345-192.168.206.48@tcp:35:ldlm_bl.0 Request processed in 2364us (2816us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1788521827.293140:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 43 00000100:00100000:0.0:1788521827.306333:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521827.306413:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799098240 00000100:00100000:1.0:1788521827.306439:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799098240 00010000:00010000:1.0:1788521827.306499:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c6f1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bc3 expref: 42 pid: 5834 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521827.306556:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 66 00000100:00100000:1.0:1788521827.306570:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad7abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+42:2363:x1875400799098240:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521827.306592:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521827.306601:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c6f1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bc3 expref: 42 pid: 5834 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.306629:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c6f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bc3 expref: 42 pid: 5834 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.306659:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c6f1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bc3 expref: 42 pid: 5834 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.306683:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687e000) 00010000:00010000:1.0:1788521827.306690:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c71b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.306702:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c71b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.306712:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c71b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.306772:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521827.306844:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad7abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+41:2363:x1875400799098240:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 277us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521827.306853:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 66 00010000:00010000:3.0:1788521827.307187:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c71b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.307198:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c71b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521827.307260:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788521827.307265:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788521827.309517:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c71b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.309550:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c71b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.309587:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c70d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.309594:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c70d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.309602:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c70d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.309608:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392d400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521827.309613:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c70d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.309622:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c70d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.309642:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:3.0:1788521827.309645:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521827.309650:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c70d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.309657:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c70d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.309675:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.309681:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c714 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.309687:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c714 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.309698:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392c800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521827.309701:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c714 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.309708:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c714 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.309716:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff996f8687e500) 00010000:00010000:3.0:1788521827.309719:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521827.309721:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c714 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.309727:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c714 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.309786:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c706 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bca expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.309802:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c71b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bca expref: 40 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.309809:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687e000) 00010000:00010000:3.0:1788521827.309812:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521827.309814:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392c400, rc 0) 00000100:00100000:3.0:1788521827.309926:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+40:11428:x1875400799097856:12345-192.168.206.48@tcp:101:stat.0 Request processed in 26025us (27159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521827.309937:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 156 00000100:00100000:0.0:1788521827.397625:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521827.399005:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799098496 00000100:00100000:1.0:1788521827.399023:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799098496 00000100:00100000:3.0:1788521827.399196:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 157 00000100:00100000:2.0:1788521827.399546:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+40:11434:x1875400799098496:12345-192.168.206.48@tcp:36:truncate.0 00010000:00010000:2.0:1788521827.399631:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521827.399668:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c71b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bca expref: 40 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521827.399696:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687e000) 00010000:00010000:2.0:1788521827.401632:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521827.402583:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c722 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521827.402606:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c722 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521827.402641:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c722 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788521827.403054:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1788521827.403091:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000274bdb3f reply state 000000008eda2198 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c722 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521827.403103:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788521827.404241:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+42:11434:x1875400799098496:12345-192.168.206.48@tcp:36:truncate.0 Request processed in 4917us (6619us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788521827.404253:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 157 00000020:00080000:2.0:1788521827.404261:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788521827.406800:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c722 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.406820:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c722 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.406828:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c722 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.406834:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490b600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521827.406839:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c722 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.406858:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c722 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.406887:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687e000) 00010000:00010000:3.0:1788521827.406890:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521827.406993:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c722 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.407003:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c722 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521827.470620:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521827.615191:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521827.615657:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799098624 00000100:00100000:1.0:1788521827.615670:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799098624 00000100:00100000:1.0:1788521827.615737:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 158 00000100:00100000:1.0:1788521827.615749:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad7aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+41:11448:x1875400799098624:12345-192.168.206.48@tcp:101:stat.0 00010000:00010000:1.0:1788521827.615778:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521827.615804:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c729 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00bd1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.615880:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c730 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.615897:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c730 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.615909:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c730 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.615924:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c737 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.615941:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.615949:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.616391:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c73e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.616400:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c73e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.616408:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c73e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521827.618293:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1788521827.618307:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521827.618359:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c73e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.618381:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c73e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.618393:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c730 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.618400:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c730 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.618407:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c730 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.618414:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521827.618418:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c730 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.618438:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c730 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.621800:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:1.0:1788521827.621815:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521827.621833:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c730 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.621849:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c730 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.621886:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.621894:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c737 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.621903:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c737 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.621908:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d4400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521827.621912:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c737 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.622685:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c737 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.622707:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff996fa0d5c600) 00010000:00010000:1.0:1788521827.622710:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521827.622715:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c737 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.622722:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c737 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.622828:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c729 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bd1 expref: 43 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.622848:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c73e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bd1 expref: 42 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.622858:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687e000) 00010000:00010000:1.0:1788521827.622861:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521827.622864:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d5400, rc 0) 00000100:00100000:1.0:1788521827.622981:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad7aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+42:11448:x1875400799098624:12345-192.168.206.48@tcp:101:stat.0 Request processed in 7232us (7837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521827.622993:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 158 00000100:00100000:0.0:1788521827.712612:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521827.712732:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799098880 00000100:00100000:2.0:1788521827.712745:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799098880 00000100:00100000:2.0:1788521827.712824:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 159 00000100:00100000:2.0:1788521827.712835:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad7a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+42:11458:x1875400799098880:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521827.712862:0:10083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521827.712892:0:10083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c745 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00bd8 expref: -99 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521827.713014:0:10083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788521827.713227:0:10083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c745 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bd8 expref: 44 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521827.713245:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fa0d5ca00) 00010000:00010000:2.0:1788521827.713249:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521827.713255:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c745 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bd8 expref: 44 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521827.713294:0:10083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490bc00, rc 0) 00000100:00100000:2.0:1788521827.713373:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad7a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+43:11458:x1875400799098880:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 539us (777us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1788521827.713381:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 159 00000100:00100000:0.0:1788521827.718958:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521827.719057:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799099136 00000100:00100000:2.0:1788521827.719071:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799099136 00000100:00100000:2.0:1788521827.719176:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 44 00000100:00100000:2.0:1788521827.719194:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f97fd2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+43:11458:x1875400799099136:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:2.0:1788521827.720720:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f97fd2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+44:11458:x1875400799099136:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 1519us (1763us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1788521827.720737:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 44 00000100:00100000:3.0:1788521827.790405:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521827.790738:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799099392 00000100:00100000:0.0:1788521827.790751:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799099392 00000100:00100000:0.0:1788521827.790825:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 160 00000100:00100000:0.0:1788521827.790853:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+44:11464:x1875400799099392:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:0.0:1788521827.790897:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521827.790921:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c753 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00bdf expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521827.791053:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c75a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521827.791070:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c73e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bd1 expref: 45 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521827.791080:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c75a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521827.791119:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c73e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bd1 expref: 45 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521827.791187:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c73e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bd1 expref: 45 pid: 5834 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521827.791203:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad7a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1875400816924544:192.168.206.48@tcp:104: 00000100:00100000:0.0:1788521827.791309:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f869896c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521827.799105:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad7a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1875400816924544:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788521827.799174:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c75a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521827.800433:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521827.801386:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799099520 00000100:00100000:2.0:1788521827.801401:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799099520 00010000:00010000:2.0:1788521827.802254:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c73e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bd1 expref: 46 pid: 5834 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521827.802362:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 67 00000100:00100000:2.0:1788521827.802380:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+46:2364:x1875400799099520:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521827.802402:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521827.802422:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c73e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bd1 expref: 46 pid: 5834 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521827.802460:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c73e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bd1 expref: 46 pid: 5834 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521827.802511:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c73e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bd1 expref: 46 pid: 5834 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521827.802536:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687e000) 00010000:00010000:2.0:1788521827.802543:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c75a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521827.802564:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c75a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521827.802574:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c75a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521827.802618:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521827.802694:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+45:2364:x1875400799099520:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 321us (2279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521827.802703:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 67 00010000:00010000:3.0:1788521827.802713:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c75a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.803130:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c75a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521827.803177:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1788521827.803383:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001400/0x1b7b50db5927c753 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bdf expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.803403:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c75a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bdf expref: 45 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.803412:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687e000) 00010000:00010000:3.0:1788521827.803415:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788521827.803418:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4000600, rc 0) 00000100:00100000:3.0:1788521827.803588:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+45:11464:x1875400799099392:12345-192.168.206.48@tcp:101:bash.0 Request processed in 12736us (13200us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1788521827.803599:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 160 00000100:00100000:0.0:1788521827.809709:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521827.809840:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799099776 00000100:00100000:2.0:1788521827.809853:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799099776 00000100:00100000:2.0:1788521827.810240:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 161 00000100:00100000:2.0:1788521827.810255:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad7ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+45:11464:x1875400799099776:12345-192.168.206.48@tcp:36:bash.0 00010000:00010000:2.0:1788521827.811321:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c768 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521827.811348:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c768 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521827.811363:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c768 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788521827.811486:0:10083:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1788521827.811838:0:10083:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8ec0f6c reply state 000000003761374b transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c768 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521827.811850:0:10083:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788521827.812309:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad7ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+48:11464:x1875400799099776:12345-192.168.206.48@tcp:36:bash.0 Request processed in 2051us (2604us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788521827.812320:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 161 00000020:00080000:2.0:1788521827.812326:0:10083:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788521827.821336:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c768 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.821363:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c768 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.821371:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c768 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.821378:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490ac00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521827.821384:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c768 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.821421:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c768 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.822785:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687e000) 00010000:00010000:3.0:1788521827.822795:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521827.822807:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c768 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.822817:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c768 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521827.823834:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521827.824267:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799099904 00000100:00100000:1.0:1788521827.824281:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799099904 00000100:00100000:1.0:1788521827.824390:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 162 00000100:00100000:1.0:1788521827.824404:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad7aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+47:11464:x1875400799099904:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:1.0:1788521827.824443:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521827.824483:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c76f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00be6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.824602:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c776 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.824620:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c75a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bdf expref: 48 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.824631:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c776 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.824695:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c75a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bdf expref: 48 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521827.824720:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c75a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bdf expref: 48 pid: 5833 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521827.824736:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f43480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875400816924672:192.168.206.48@tcp:104: 00000100:00100000:1.0:1788521827.824856:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fad804240 going to sleep for 11 seconds 00000100:00100000:2.0:1788521827.829778:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521827.830388:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799100032 00000100:00100000:0.0:1788521827.830402:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799100032 00010000:00010000:0.0:1788521827.830485:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c75a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bdf expref: 49 pid: 5833 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521827.830571:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 68 00000100:00100000:0.0:1788521827.830583:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+49:2363:x1875400799100032:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521827.830604:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521827.830612:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c75a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bdf expref: 49 pid: 5833 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521827.830635:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c75a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bdf expref: 49 pid: 5833 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521827.830664:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687e000) 00010000:00010000:0.0:1788521827.830670:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c776 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521827.830681:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c776 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521827.830689:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c776 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521827.830712:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521827.830779:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+49:2363:x1875400799100032:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 198us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521827.830787:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 68 00010000:00010000:2.0:1788521827.831760:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c75a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bdf expref: 48 pid: 5833 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521827.831786:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f43480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875400816924672:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788521827.831821:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c776 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521827.831832:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c776 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521827.831839:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c776 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521827.831925:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788521827.831930:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521827.831964:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c776 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521827.832008:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c76f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00be6 expref: 48 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521827.832263:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c776 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00be6 expref: 47 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521827.832273:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687e000) 00010000:00010000:2.0:1788521827.832276:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521827.832280:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d4400, rc 0) 00000100:00100000:2.0:1788521827.832349:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad7aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+47:11464:x1875400799099904:12345-192.168.206.48@tcp:101:bash.0 Request processed in 7948us (8525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521827.832359:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 162 00000100:00100000:2.0:1788521827.836282:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521827.836566:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799100288 00000100:00100000:3.0:1788521827.836581:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799100288 00000100:00100000:3.0:1788521827.836661:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 45 00000100:00100000:3.0:1788521827.836674:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+47:11464:x1875400799100288:12345-192.168.206.48@tcp:35:bash.0 00000100:00100000:3.0:1788521827.837647:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+48:11464:x1875400799100288:12345-192.168.206.48@tcp:35:bash.0 Request processed in 970us (1374us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1788521827.837659:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 45 00000100:00100000:1.0:1788521827.933839:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521827.934201:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799100544 00000100:00100000:0.0:1788521827.934215:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799100544 00000100:00100000:0.0:1788521827.934300:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 163 00000100:00100000:0.0:1788521827.934313:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+48:11474:x1875400799100544:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1788521827.934366:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521827.934394:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927c77d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00bed expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521827.934538:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788521827.934759:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927c77d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bed expref: 50 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521827.934777:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fa0d5ca00) 00010000:00010000:0.0:1788521827.934781:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788521827.934786:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927c77d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bed expref: 50 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521827.934802:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4000000, rc 0) 00000100:00100000:0.0:1788521827.934950:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+49:11474:x1875400799100544:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 639us (1128us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1788521827.934960:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 163 00000100:00100000:0.0:1788521827.943721:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521827.944029:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799100672 00000100:00100000:3.0:1788521827.944043:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799100672 00000100:00100000:3.0:1788521827.944196:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 164 00000100:00100000:3.0:1788521827.944209:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad7ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+49:11474:x1875400799100672:12345-192.168.206.48@tcp:34:lfs.0 00010000:00010000:3.0:1788521827.944320:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c78b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.944343:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c78b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.944387:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c78b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.944406:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c792 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.944414:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c792 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.944421:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c792 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.944741:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c799 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.944752:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.944759:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788521827.946232:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.946261:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c78b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.946270:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c78b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.946277:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c78b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.946308:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392de00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521827.946313:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c78b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.946323:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c78b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.946406:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:3.0:1788521827.946410:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521827.946416:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c78b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.946422:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c78b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.946519:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c792 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.946525:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c792 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.946531:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c792 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.946536:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392c800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521827.946538:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c792 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.946544:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c792 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.946565:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff996f8687e500) 00010000:00010000:3.0:1788521827.946567:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521827.946571:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c792 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.946577:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c792 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.946600:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.946606:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c799 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.946612:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c799 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.946617:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392d400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521827.946620:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c799 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.946626:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c799 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.946634:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687e000) 00010000:00010000:3.0:1788521827.946636:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521827.946638:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c799 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521827.946644:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c799 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521827.946790:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad7ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+49:11474:x1875400799100672:12345-192.168.206.48@tcp:34:lfs.0 Request processed in 2578us (3079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521827.946804:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 164 00000100:00100000:2.0:1788521827.953390:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521827.953458:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799100928 00000100:00100000:3.0:1788521827.953472:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799100928 00000100:00100000:3.0:1788521827.953546:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00100000:3.0:1788521827.953558:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+49:11474:x1875400799100928:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:3.0:1788521827.953874:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+50:11474:x1875400799100928:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 318us (497us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788521827.953883:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00100000:1.0:1788521828.002264:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521828.002535:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799101184 00000100:00100000:2.0:1788521828.002548:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799101184 00000100:00100000:2.0:1788521828.003607:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 165 00000100:00100000:2.0:1788521828.003633:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+50:11477:x1875400799101184:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521828.004174:0:10083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521828.004210:0:10083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c7a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00bf4 expref: -99 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.004309:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c7a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.004327:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c7a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.004341:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c7a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.004380:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c7ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.004388:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c7ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.004395:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c7ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.004769:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c7b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.004780:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c7b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.004787:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c7b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521828.004798:0:10083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788521828.005820:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c7a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.006009:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c7a7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.006017:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c7a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.006022:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490ac00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521828.006028:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c7a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.006059:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c7a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.006079:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:2.0:1788521828.006083:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521828.006089:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c7a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.006097:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c7a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.006118:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c7ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.006123:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c7ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.006128:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c7ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.006134:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490bc00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521828.006137:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c7ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.006197:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c7ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.006206:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff996fb19efb00) 00010000:00010000:2.0:1788521828.006209:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521828.006212:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c7ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.006230:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c7ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.006313:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c7a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bf4 expref: 53 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.006331:0:10083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c7b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bf4 expref: 52 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.006340:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687e000) 00010000:00010000:2.0:1788521828.006342:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521828.006345:0:10083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490b600, rc 0) 00000100:00100000:2.0:1788521828.006697:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+52:11477:x1875400799101184:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 3072us (4445us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1788521828.006708:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 165 00000100:00100000:0.0:1788521828.015556:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521828.015929:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521828.016095:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799101440 00000100:00100000:3.0:1788521828.016107:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799101440 00000100:00100000:3.0:1788521828.016229:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:3.0:1788521828.016243:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7897b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+52:2362:x1875400799101440:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521828.016264:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521828.016296:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c7b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bf4 expref: 52 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.016320:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687e000) 00010000:00010000:3.0:1788521828.016334:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521828.016405:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7897b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+51:2362:x1875400799101440:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 165us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521828.016414:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:2.0:1788521828.017481:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799101312 00000100:00100000:2.0:1788521828.017803:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799101312 00000100:00100000:2.0:1788521828.017950:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 166 00000100:00100000:2.0:1788521828.017960:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad7a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+51:11477:x1875400799101312:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:2.0:1788521828.018047:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c7c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.018070:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.018088:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.018690:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.018701:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c7c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.018803:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c7c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.018883:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490ac00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521828.018889:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c7c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.018899:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c7c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.018917:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687e000) 00010000:00010000:2.0:1788521828.018920:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521828.018926:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c7c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.018934:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c7c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521828.019109:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad7a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+51:11477:x1875400799101312:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 1145us (3562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521828.019120:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 166 00000100:00100000:0.0:1788521828.026378:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521828.026485:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799101696 00000100:00100000:3.0:1788521828.026499:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799101696 00000100:00100000:3.0:1788521828.026592:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 47 00000100:00100000:3.0:1788521828.026606:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+51:11477:x1875400799101696:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:3.0:1788521828.027111:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+52:11477:x1875400799101696:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 506us (745us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788521828.027121:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 47 00000100:00100000:3.0:1788521828.198661:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521828.198807:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799101952 00000100:00100000:0.0:1788521828.198820:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799101952 00000100:00100000:0.0:1788521828.198899:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 167 00000100:00100000:0.0:1788521828.198911:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+52:11495:x1875400799101952:12345-192.168.206.48@tcp:101:cat.0 00010000:00010000:0.0:1788521828.198945:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521828.198972:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c7ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00bfb expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.199171:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c7d1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.199190:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c7d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.199203:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c7d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521828.199217:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788521828.199381:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c7ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bfb expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.199402:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c7d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bfb expref: 54 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.199412:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687e000) 00010000:00010000:0.0:1788521828.199415:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788521828.199419:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4000400, rc 0) 00000100:00100000:0.0:1788521828.199532:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+54:11495:x1875400799101952:12345-192.168.206.48@tcp:101:cat.0 Request processed in 620us (884us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1788521828.199541:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 167 00000100:00100000:0.0:1788521828.233744:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521828.233857:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799102080 00000100:00100000:3.0:1788521828.233870:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799102080 00000100:00100000:3.0:1788521828.234006:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 168 00000100:00100000:3.0:1788521828.234020:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+54:11496:x1875400799102080:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521828.234049:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521828.234076:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c7df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00c02 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.234196:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c7e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.234225:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c7e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.234240:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c7e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521828.234283:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788521828.234288:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788521828.234309:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c7e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.234340:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c7df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c02 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.234378:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c7e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c02 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.234388:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:3.0:1788521828.234392:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788521828.234397:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392c800, rc 0) 00000100:00100000:3.0:1788521828.234489:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+55:11496:x1875400799102080:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 472us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521828.234498:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 168 00000100:00100000:3.0:1788521828.238776:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521828.239414:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799102464 00000100:00100000:2.0:1788521828.239438:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799102464 00000100:00100000:2.0:1788521828.239530:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 48 00000100:00100000:2.0:1788521828.239563:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbcb31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+55:11496:x1875400799102464:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:2.0:1788521828.240015:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbcb31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+56:11496:x1875400799102464:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 454us (1253us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788521828.240024:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 48 00000100:00100000:0.0:1788521828.244084:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521828.244204:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799102592 00000100:00100000:2.0:1788521828.244217:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799102592 00000100:00100000:2.0:1788521828.245412:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:2.0:1788521828.245459:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f856e4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+56:11496:x1875400799102592:12345-192.168.206.48@tcp:103:lfs.0 00010000:00010000:2.0:1788521828.245486:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788521828.245525:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c776 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00be6 expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.246355:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927c7d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00bfb expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.246378:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927c681 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ba7 expref: 54 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.246392:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687e000) 00010000:00010000:2.0:1788521828.246407:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521828.246517:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f856e4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+53:11496:x1875400799102592:12345-192.168.206.48@tcp:103:lfs.0 Request processed in 1090us (2591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521828.246529:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:0.0:1788521828.252510:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521828.254606:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799102720 00000100:00100000:2.0:1788521828.254624:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799102720 00000100:00100000:2.0:1788521828.254705:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 169 00000100:00100000:2.0:1788521828.254717:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+53:11496:x1875400799102720:12345-192.168.206.48@tcp:58:lfs.0 00010000:00010000:2.0:1788521828.256376:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c7ed lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.256411:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c7ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.256436:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c7ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788521828.256688:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788521828.256810:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+53:11496:x1875400799102720:12345-192.168.206.48@tcp:58:lfs.0 Request processed in 2090us (4309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521828.256820:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 169 00000100:00100000:1.0:1788521828.285304:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521828.286092:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799102848 00000100:00100000:2.0:1788521828.286107:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799102848 00000100:00100000:2.0:1788521828.286341:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 170 00000100:00100000:2.0:1788521828.286353:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+53:11498:x1875400799102848:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521828.286380:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521828.286408:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c7f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00c09 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.286508:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c7fb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.286526:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c7fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.286550:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c7fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.286588:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c802 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.286597:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.286605:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.286890:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927c809 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.286900:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927c809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.286908:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927c809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521828.286953:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788521828.286958:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521828.286982:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927c809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.286995:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927c809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.287004:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c7fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.287011:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c7fb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.287029:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c7fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.287035:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490bc00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521828.287040:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c7fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.287049:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c7fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.287063:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:2.0:1788521828.287067:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521828.287071:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c7fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.287078:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c7fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.287093:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.287100:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c802 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.287105:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c802 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.287110:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490a400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521828.287113:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c802 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.287129:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c802 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.287137:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff996fb19ef500) 00010000:00010000:2.0:1788521828.287198:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521828.287203:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c802 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.287210:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c802 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.287249:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c7f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c09 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.287263:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927c809 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c09 expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.287271:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996fb19efb00) 00010000:00010000:2.0:1788521828.287274:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788521828.287276:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490b000, rc 0) 00000100:00100000:2.0:1788521828.287511:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+54:11498:x1875400799102848:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 1158us (2222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521828.287519:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 170 00000040:00080000:3.0:1788521828.302471:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788521828.302483:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788521828.302527:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1788521828.302550:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788521828.302722:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb30a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1875400816924800:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788521828.302926:0:11682:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fbc3d6000 going to sleep for 11 seconds 00000100:00100000:3.0:1788521828.308058:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb30a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1875400816924800:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788521828.316113:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521828.316281:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799102976 00000100:00100000:2.0:1788521828.316293:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799102976 00000100:00100000:2.0:1788521828.316362:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 171 00000100:00100000:2.0:1788521828.316373:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+54:11501:x1875400799102976:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788521828.316467:0:5835:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788521828.316618:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+54:11501:x1875400799102976:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 246us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521828.316626:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 171 00000100:00100000:3.0:1788521828.325762:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521828.326254:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799103104 00000100:00100000:0.0:1788521828.326287:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799103104 00000100:00100000:0.0:1788521828.326391:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 172 00000100:00100000:0.0:1788521828.326404:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbcb30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+54:11501:x1875400799103104:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788521828.326522:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c810 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.326545:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c810 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.326560:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c810 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.340200:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c817 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.340225:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c817 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.340238:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c817 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.340275:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c81e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.340284:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c81e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.340291:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c81e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521828.340354:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788521828.340359:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521828.340374:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c81e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.340387:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c810 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.340394:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c810 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.340402:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c810 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.340409:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521828.340414:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c810 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.340435:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c810 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.340451:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996fb19efc00) 00010000:00010000:1.0:1788521828.340454:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521828.340460:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c810 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.340467:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927c810 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.340483:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c817 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.340498:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c817 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.340504:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c817 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.340509:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d4000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521828.340512:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c817 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.340518:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c817 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.340525:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff996fa0d5c600) 00010000:00010000:1.0:1788521828.340528:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521828.340531:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c817 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.340536:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c817 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.340553:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c81e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.340560:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c81e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.340565:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c81e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.340570:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521828.340579:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c81e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.340585:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c81e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.340593:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996fb19efb00) 00010000:00010000:1.0:1788521828.340595:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521828.340598:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c81e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.340604:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c81e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521828.340687:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbcb30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+54:11501:x1875400799103104:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 Request processed in 14283us (14942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521828.340697:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 172 00000100:00100000:3.0:1788521828.350649:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521828.351257:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799103360 00000100:00100000:2.0:1788521828.351272:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799103360 00000100:00100000:2.0:1788521828.351330:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 173 00000100:00100000:2.0:1788521828.351340:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+54:11501:x1875400799103360:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521828.351362:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521828.351382:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c825 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00c10 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.351499:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c82c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.351515:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c82c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.351527:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c82c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521828.351538:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788521828.351642:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c82c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.351651:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c82c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.351657:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c82c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.351675:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490a400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521828.351680:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c82c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.351688:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c82c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.351700:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996fb19efb00) 00010000:00010000:2.0:1788521828.351703:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788521828.351707:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c82c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.351714:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c82c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.351755:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c825 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c10 expref: 56 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.351769:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996fb19efc00) 00010000:00010000:2.0:1788521828.351772:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521828.351776:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c825 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c10 expref: 56 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.351785:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490a200, rc 0) 00000100:00100000:2.0:1788521828.351863:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+55:11501:x1875400799103360:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 524us (1229us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1788521828.351871:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 173 00000100:00100000:0.0:1788521828.372480:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521828.372644:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799103488 00000100:00100000:2.0:1788521828.372675:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799103488 00000100:00100000:2.0:1788521828.372748:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 174 00000100:00100000:2.0:1788521828.372759:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+55:11501:x1875400799103488:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788521828.372818:0:5834:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788521828.372929:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+55:11501:x1875400799103488:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 172us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521828.372937:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 174 00000100:00100000:3.0:1788521828.378135:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521828.378286:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799103744 00000100:00100000:2.0:1788521828.378300:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799103744 00000100:00100000:2.0:1788521828.378358:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 175 00000100:00100000:2.0:1788521828.378366:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+55:11501:x1875400799103744:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521828.378384:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521828.378387:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788521828.378410:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c7e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c02 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.378443:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:2.0:1788521828.378456:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521828.378470:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c83a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00c17 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788521828.378998:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788521828.380169:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c841 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.380187:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c841 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.380221:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c841 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.380288:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c83a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c17 expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.380305:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c841 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c17 expref: 56 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.380313:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff996fb19ef500) 00010000:00010000:2.0:1788521828.380316:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521828.380319:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490a400, rc 0) 00000100:00100000:2.0:1788521828.380385:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+56:11501:x1875400799103744:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 2017us (2262us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1788521828.380394:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 175 00000100:00100000:3.0:1788521828.385465:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521828.385573:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799104000 00000100:00100000:2.0:1788521828.385589:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799104000 00000100:00100000:2.0:1788521828.385710:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 176 00000100:00100000:2.0:1788521828.385722:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+56:11501:x1875400799104000:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788521828.385779:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521828.385805:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c841 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c17 expref: 56 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.385825:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff996fb19ef500) 00010000:00010000:2.0:1788521828.385834:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521828.385853:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c84f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.385879:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c84f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.385889:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c84f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.385946:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c856 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xafc538db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.385954:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c856 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xafc538db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.385960:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c856 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xafc538db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.386189:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c84f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.386197:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c84f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.386204:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c84f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.386209:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490bc00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521828.386213:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c84f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.386222:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c84f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.386234:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:2.0:1788521828.386242:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521828.386246:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c84f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.386253:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c84f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.386263:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c856 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xafc538db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.386269:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c856 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xafc538db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.386275:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c856 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xafc538db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.386280:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490aa00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521828.386283:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c856 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xafc538db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.386289:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c856 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xafc538db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.386297:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xafc538db (ffff996fb19ef000) 00010000:00010000:2.0:1788521828.386300:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521828.386303:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c856 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xafc538db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.386308:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c856 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xafc538db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521828.386393:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+55:11501:x1875400799104000:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 673us (954us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788521828.386406:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 176 00000100:00100000:0.0:1788521828.393661:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521828.394119:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799104128 00000100:00100000:1.0:1788521828.394128:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799104128 00000100:00100000:1.0:1788521828.394213:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 177 00000100:00100000:1.0:1788521828.394223:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+55:11501:x1875400799104128:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788521828.394242:0:10083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521828.394264:0:10083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c85d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00c1e expref: -99 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.394298:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c864 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.394311:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.394341:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.394443:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c85d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c1e expref: 57 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.394478:0:10083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c864 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c1e expref: 56 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.394487:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff996fa0d5c600) 00010000:00010000:1.0:1788521828.394490:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788521828.394493:0:10083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d4000, rc 0) 00000100:00100000:1.0:1788521828.394549:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+56:11501:x1875400799104128:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 327us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521828.394556:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 177 00000100:00100000:3.0:1788521828.396901:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521828.396983:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799104384 00000100:00100000:2.0:1788521828.396995:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799104384 00000100:00100000:2.0:1788521828.397062:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 178 00000100:00100000:2.0:1788521828.397072:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+56:11501:x1875400799104384:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788521828.397173:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c86b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.397188:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c86b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.397199:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c86b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788521828.397762:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1788521828.397776:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 328382633208ns, next at 329382630457ns, rc = 0 00000004:00010000:3.0:1788521828.397997:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e1f1655 reply state 000000008440f095 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c86b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521828.398025:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788521828.398197:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+58:11501:x1875400799104384:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 1123us (1303us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1788521828.398207:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 178 00010000:00010000:3.0:1788521828.403717:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c86b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.403734:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c86b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.403741:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c86b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.403746:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490b600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521828.403751:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c86b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.403757:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c86b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.403773:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff996fa0d5c600) 00010000:00010000:3.0:1788521828.403775:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788521828.403780:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c86b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.403785:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c86b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521828.403855:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521828.404019:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799104512 00000100:00100000:2.0:1788521828.404037:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799104512 00000100:00100000:2.0:1788521828.404244:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 179 00000100:00100000:2.0:1788521828.404257:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+57:11501:x1875400799104512:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521828.404294:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521828.404320:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c872 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00c25 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.404400:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c872 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c25 expref: 58 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.404417:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c872 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c25 expref: 58 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.404488:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff996fa0d5c600) 00010000:00010000:2.0:1788521828.404492:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788521828.404495:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490a200, rc 0) 00000100:00100000:2.0:1788521828.404576:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+58:11501:x1875400799104512:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 322us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521828.404583:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 179 00000100:00100000:0.0:1788521828.409882:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521828.410008:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799104640 00000100:00100000:3.0:1788521828.410022:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799104640 00000100:00080000:0.0:1788521828.410484:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521828.410548:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 50 00000100:00100000:3.0:1788521828.410563:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+6:2364:x1875400799104640:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788521828.410889:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2364:x1875400799104640:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 330us (1028us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788521828.412003:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 50 00000100:00100000:3.0:1788521828.412920:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521828.413010:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799104896 00000100:00100000:0.0:1788521828.413018:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799104896 00000100:00100000:0.0:1788521828.413070:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 49 00000100:00100000:0.0:1788521828.413090:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+58:11501:x1875400799104896:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788521828.413331:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+59:11501:x1875400799104896:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 252us (412us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788521828.413339:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 49 00000100:00100000:0.0:1788521828.422158:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521828.422350:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799105152 00000100:00100000:1.0:1788521828.422359:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799105152 00000100:00100000:1.0:1788521828.422412:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 180 00000100:00100000:1.0:1788521828.422432:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+59:11501:x1875400799105152:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788521828.422623:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+59:11501:x1875400799105152:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 202us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521828.422631:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 180 00000100:00100000:1.0:1788521828.430836:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521828.430986:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799105280 00000100:00100000:2.0:1788521828.431005:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799105280 00000100:00100000:2.0:1788521828.431089:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 181 00000100:00100000:2.0:1788521828.431105:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+59:11501:x1875400799105280:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521828.431132:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521828.431283:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c879 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00c2c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.431379:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c880 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.431397:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.431411:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521828.431470:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521828.431495:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.431525:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c879 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c2c expref: 61 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.431563:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c880 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c2c expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.431573:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff996fa0d5c600) 00010000:00010000:2.0:1788521828.431575:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788521828.431580:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490bc00, rc 0) 00000100:00100000:2.0:1788521828.431663:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+60:11501:x1875400799105280:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 563us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521828.431672:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 181 00000100:00100000:1.0:1788521828.437319:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521828.437936:0:12322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799105408 00000100:00100000:2.0:1788521828.437958:0:12322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799105408 00000100:00100000:2.0:1788521828.438061:0:12322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 51 00000100:00100000:2.0:1788521828.438079:0:12322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2363:x1875400799105408:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521828.438108:0:12322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521828.438175:0:12322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005936e3bc/0x1b7b50db5927c887 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00c33 expref: -99 pid: 12322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788521828.438345:0:12322:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9aad64, blocks: 0x1 00010000:00010000:2.0:1788521828.438373:0:12322:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=328s v=(0 0) 00010000:00010000:2.0:1788521828.438379:0:12322:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521828.438392:0:12322:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005936e3bc/0x1b7b50db5927c887 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c33 expref: 8 pid: 12322 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.438416:0:12322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005936e3bc/0x1b7b50db5927c887 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c33 expref: 8 pid: 12322 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.438468:0:12322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490a400, rc 0) 00000100:00100000:2.0:1788521828.438546:0:12322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+8:2363:x1875400799105408:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 473us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521828.438554:0:12322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 51 00000100:00100000:0.0:1788521828.441857:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521828.441991:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799105664 00000100:00100000:3.0:1788521828.442000:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799105664 00000100:00100000:3.0:1788521828.442057:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 182 00000100:00100000:3.0:1788521828.442067:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+60:11501:x1875400799105664:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788521828.442598:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+60:11501:x1875400799105664:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 530us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521828.442607:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 182 00000100:00100000:1.0:1788521828.448326:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521828.450040:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799105792 00000100:00100000:2.0:1788521828.450054:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799105792 00000100:00100000:2.0:1788521828.450129:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 52 00000100:00100000:2.0:1788521828.450335:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+8:11501:x1875400799105792:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521828.450356:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521828.450376:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033e1d75f/0x1b7b50db5927c88e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00c3a expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.450407:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005936e3bc/0x1b7b50db5927c887 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c33 expref: 9 pid: 12322 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.450417:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521828.450432:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521828.450439:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033e1d75f/0x1b7b50db5927c88e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c3a expref: 9 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.450549:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005936e3bc/0x1b7b50db5927c887 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c33 expref: 9 pid: 12322 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.450570:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005936e3bc/0x1b7b50db5927c887 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c33 expref: 9 pid: 12322 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521828.450599:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb4a67100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6689:1875400816924928:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788521828.450748:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f82df43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521828.461775:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521828.461882:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb4a67100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6689:1875400816924928:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788521828.461941:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000033e1d75f/0x1b7b50db5927c88e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c3a expref: 9 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.461962:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490aa00, rc 0) 00000100:00100000:1.0:1788521828.462021:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+9:11501:x1875400799105792:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 11882us (13704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521828.462030:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 52 00000100:00100000:3.0:1788521828.462870:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799105920 00000100:00100000:3.0:1788521828.462995:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799105920 00010000:00010000:3.0:1788521828.463042:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005936e3bc/0x1b7b50db5927c887 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c33 expref: 9 pid: 12322 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521828.463091:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 69 00000100:00100000:3.0:1788521828.463102:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+9:2363:x1875400799105920:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521828.463115:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521828.463162:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005936e3bc/0x1b7b50db5927c887 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c33 expref: 9 pid: 12322 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.463254:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005936e3bc/0x1b7b50db5927c887 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c33 expref: 9 pid: 12322 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.463287:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005936e3bc/0x1b7b50db5927c887 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c33 expref: 9 pid: 12322 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.463302:0:7632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521828.463306:0:7632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521828.463314:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000033e1d75f/0x1b7b50db5927c88e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c3a expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.463324:0:7632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033e1d75f/0x1b7b50db5927c88e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c3a expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.463361:0:7632:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000033e1d75f/0x1b7b50db5927c88e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c3a expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521828.463374:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad92aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7632:1875400816925056:192.168.206.48@tcp:105: 00000100:00100000:3.0:1788521828.464659:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fbc3d6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788521828.467719:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad92aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7632:1875400816925056:192.168.206.48@tcp:105: 00010000:00010000:3.0:1788521828.467744:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521828.467800:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+8:2363:x1875400799105920:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 4700us (6034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521828.467811:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 69 00000100:00100000:3.0:1788521828.469619:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521828.469846:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799106048 00000100:00100000:2.0:1788521828.469856:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799106048 00002000:00100000:2.0:1788521828.469920:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff996fad92aa00 x1875400799106048/t0(0) o4->4bd13e8f-aac9-42ad-8625-a542705d6920@192.168.206.48@tcp:74/0 lens 504/0 e 0 to 0 dl 1788521839 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788521828.469932:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff996fad92aa00 with x1875400799106048 ext(0->8) 00002000:00010000:2.0:1788521828.469937:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996fad92aa00 00000100:00100000:2.0:1788521828.469966:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:2.0:1788521828.469976:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad92aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+8:2364:x1875400799106048:12345-192.168.206.48@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788521828.470442:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad92aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+10:2364:x1875400799106048:12345-192.168.206.48@tcp:4:lhsmtool_posix.0 Request processed in 466us (1000us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788521828.470464:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 4 00002000:00100000:2.0:1788521828.470480:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff996fad92aa00 x1875400799106048/t4294967314(0) o4->4bd13e8f-aac9-42ad-8625-a542705d6920@192.168.206.48@tcp:74/0 lens 504/448 e 0 to 0 dl 1788521839 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788521828.470488:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff996fad92aa00 with x1875400799106048 ext(0->8) 00002000:00010000:2.0:1788521828.470492:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996fad92aa00 00000100:00100000:2.0:1788521828.482828:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521828.483362:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799106176 00000100:00100000:0.0:1788521828.483372:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799106176 00000100:00100000:0.0:1788521828.483435:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 183 00000100:00100000:0.0:1788521828.484592:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+60:11501:x1875400799106176:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 00010000:00010000:3.0:1788521828.502464:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788521828.529100:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1788521828.529213:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788521828.529237:0:5856:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff996fbc3c4780 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788521828.529242:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff996fa0361e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff996fbc3c4300 00000020:00080000:3.0:1788521828.529245:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff996fa0361400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff996fb7879400 00000004:00080000:3.0:1788521828.529260:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:0.0:1788521828.530097:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+18:11501:x1875400799106176:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 Request processed in 45509us (47271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521828.530174:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 183 00000020:00080000:0.0:1788521828.530205:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1788521828.530380:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788521828.530398:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7a7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816925312:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788521828.530947:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521828.530991:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad92bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816925184:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788521828.531019:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521828.531058:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816925312 00000100:00100000:0.0:1788521828.531066:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816925312 00000100:00100000:0.0:1788521828.531107:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816925184 00000100:00100000:0.0:1788521828.531111:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816925184 00000100:00100000:0.0:1788521828.531135:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788521828.531161:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1875400816925312:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788521828.531186:0:11097:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:0.0:1788521828.531216:0:11097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9aad62, atime: 0x6a9aad62, ctime: 0x6a9aad62, blocks: 0x1 00010000:00010000:0.0:1788521828.531224:0:11097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cc9d197/0x1b7b50db5927c895 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.531239:0:11097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=328s v=(0 0) 00010000:00010000:0.0:1788521828.531244:0:11097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521828.531249:0:11097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cc9d197/0x1b7b50db5927c895 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.531281:0:11097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cc9d197/0x1b7b50db5927c895 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.531291:0:11097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cc9d197/0x1b7b50db5927c895 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.531298:0:11097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cc9d197/0x1b7b50db5927c895 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.531316:0:11097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788521828.532063:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788521828.532078:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7894380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816925184:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788521828.532243:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788521828.532246:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788521828 00002000:00010000:3.0:1788521828.532249:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788521828.532251:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788521828 -> 1788521828 00002000:00010000:3.0:1788521828.532253:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788521828.532308:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7894380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1875400816925184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 234us (1287us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788521828.532315:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1788521828.533211:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788521828.533217:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788521828.533335:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3304:x1875400816925312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2190us (2869us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788521828.533344:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00010000:0.0:1788521828.533370:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521828.533379:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cc9d197/0x1b7b50db5927c895 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.533391:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4001c00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521828.533395:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cc9d197/0x1b7b50db5927c895 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.533406:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cc9d197/0x1b7b50db5927c895 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.533432:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cc9d197/0x1b7b50db5927c895 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.533452:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cc9d197/0x1b7b50db5927c895 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.535382:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521828.535386:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521828.535389:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788521828.535443:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff996fb7a7f480/2, rc 0, transno 4294967307 00000100:00100000:0.0:1788521828.535453:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7a7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816925312:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788521828.535664:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff996fad92bb80/2, rc 0, transno 4294967315 00000100:00100000:0.0:1788521828.535670:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad92bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816925184:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788521828.536066:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521828.536591:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799106304 00000100:00100000:1.0:1788521828.536599:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799106304 00000100:00100000:1.0:1788521828.536656:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 55 00000100:00100000:1.0:1788521828.536667:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad7a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+10:2362:x1875400799106304:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788521828.592016:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad7a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+10:2362:x1875400799106304:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 Request processed in 55341us (55943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521828.592030:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 55 00000001:00080000:1.0:1788521828.592064:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:1.0:1788521828.592078:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1788521828.600191:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521828.600803:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799106560 00000100:00100000:1.0:1788521828.600813:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799106560 00000100:00100000:1.0:1788521828.600887:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 184 00000100:00100000:1.0:1788521828.600899:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad92a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+18:11501:x1875400799106560:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788521828.600951:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521828.600977:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c880 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c2c expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.600997:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff996fa0d5c600) 00010000:00010000:1.0:1788521828.601002:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788521828.601043:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c89c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.601058:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c89c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.601068:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c89c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788521828.601330:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c5e2357 reply state 00000000a05b61b9 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c89c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521828.601339:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788521828.601458:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad92a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+19:11501:x1875400799106560:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 551us (1264us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788521828.601714:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 184 00010000:00010000:3.0:1788521828.604510:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c89c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.604658:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c89c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.604667:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c89c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.604673:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521828.604678:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c89c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.604697:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c89c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.604713:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff996fa0d5c600) 00010000:00010000:3.0:1788521828.604716:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521828.604722:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c89c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.604729:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927c89c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521828.604789:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521828.604955:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799106688 00000100:00100000:3.0:1788521828.604964:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799106688 00000100:00100000:3.0:1788521828.605054:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 56 00000100:00100000:3.0:1788521828.605064:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad7abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2363:x1875400799106688:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788521828.605729:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788521828.605733:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788521828 -> 1788521828 00002000:00010000:3.0:1788521828.605735:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788521826 00002000:00010000:3.0:1788521828.605738:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788521828 -> 1788521828 00002000:00010000:3.0:1788521828.605740:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788521828.605835:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad7abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+8:2363:x1875400799106688:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 771us (1047us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788521828.605844:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 56 00000100:00100000:0.0:1788521828.609620:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521828.609843:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799106944 00000100:00100000:2.0:1788521828.609853:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799106944 00000100:00100000:2.0:1788521828.609908:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 185 00000100:00100000:2.0:1788521828.609917:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+18:11501:x1875400799106944:12345-192.168.206.48@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788521828.609987:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c8a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.610003:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c864 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c1e expref: 18 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.610020:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c8a3 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.610050:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c864 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c1e expref: 18 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.610070:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c864 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c1e expref: 18 pid: 10083 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521828.610083:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875400816925440:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788521828.610178:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f82df4900 going to sleep for 11 seconds 00000100:00100000:3.0:1788521828.615341:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875400816925440:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788521828.615374:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c8a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521828.616388:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521828.616694:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799107072 00000100:00100000:3.0:1788521828.616703:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799107072 00010000:00010000:3.0:1788521828.616745:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c864 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c1e expref: 19 pid: 10083 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521828.616781:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 70 00000100:00100000:3.0:1788521828.616792:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7895880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+19:2363:x1875400799107072:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521828.616807:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521828.616814:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c864 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c1e expref: 19 pid: 10083 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.616833:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c864 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c1e expref: 19 pid: 10083 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.616867:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c864 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c1e expref: 19 pid: 10083 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.617195:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff996fa0d5c600) 00010000:00010000:3.0:1788521828.617202:0:7633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c8a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.617211:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c8a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.617218:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c8a3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.617241:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521828.617300:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7895880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+18:2363:x1875400799107072:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 508us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521828.617307:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 70 00010000:00010000:2.0:1788521828.617351:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c8a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.617362:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c8a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.617388:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c8a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.617405:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c8a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.617412:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c8a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.617419:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490a400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521828.617435:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c8a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.617443:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c8a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.617454:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff996fa0d5c600) 00010000:00010000:2.0:1788521828.617456:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788521828.617460:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c8a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.617467:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c8a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521828.617509:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+17:11501:x1875400799106944:12345-192.168.206.48@tcp:55:lhsmtool_posix.0 Request processed in 7592us (7897us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788521828.617516:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 185 00000100:00100000:0.0:1788521828.628754:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521828.628830:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799107200 00000100:00100000:1.0:1788521828.628842:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799107200 00000100:00100000:1.0:1788521828.628967:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 57 00000100:00100000:1.0:1788521828.628981:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7896a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+8:2361:x1875400799107200:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788521828.629193:0:11097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e86ae903/0x1b7b50db5927c8aa lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.629281:0:11097:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000033e1d75f/0x1b7b50db5927c88e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c3a expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.629289:0:11097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521828.629293:0:11097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788521828.629298:0:11097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e86ae903/0x1b7b50db5927c8aa lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.629346:0:11097:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000033e1d75f/0x1b7b50db5927c88e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c3a expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.629368:0:11097:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000033e1d75f/0x1b7b50db5927c88e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c3a expref: 8 pid: 6689 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521828.629383:0:11097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11097:1875400816925568:192.168.206.48@tcp:104: 00000100:00100000:1.0:1788521828.629466:0:11097:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fad804a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521828.637277:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521828.637327:0:11097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11097:1875400816925568:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788521828.637342:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799107328 00000100:00100000:3.0:1788521828.637351:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799107328 00010000:00010000:1.0:1788521828.637356:0:11097:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e86ae903/0x1b7b50db5927c8aa lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.637388:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000033e1d75f/0x1b7b50db5927c88e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c3a expref: 9 pid: 6689 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521828.637441:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 71 00000100:00100000:3.0:1788521828.637451:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7894a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+9:2363:x1875400799107328:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521828.637465:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521828.637487:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000033e1d75f/0x1b7b50db5927c88e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c3a expref: 9 pid: 6689 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.637507:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000033e1d75f/0x1b7b50db5927c88e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c3a expref: 9 pid: 6689 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.637528:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033e1d75f/0x1b7b50db5927c88e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c3a expref: 9 pid: 6689 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.637543:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521828.637548:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521828.637554:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e86ae903/0x1b7b50db5927c8aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.637564:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e86ae903/0x1b7b50db5927c8aa lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.637612:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788521828.637670:0:11097:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e86ae903/0x1b7b50db5927c8aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.637681:0:11097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e86ae903/0x1b7b50db5927c8aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.637706:0:11097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e86ae903/0x1b7b50db5927c8aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.637715:0:11097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e86ae903/0x1b7b50db5927c8aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.637748:0:11097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e86ae903/0x1b7b50db5927c8aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.637759:0:11097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5000 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:1.0:1788521828.637764:0:11097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e86ae903/0x1b7b50db5927c8aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521828.637769:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7894a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+8:2363:x1875400799107328:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 316us (499us total) trans 0 rc 0/0 00010000:00010000:1.0:1788521828.637780:0:11097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e86ae903/0x1b7b50db5927c8aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521828.637783:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 71 00010000:00010000:1.0:1788521828.637800:0:11097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e86ae903/0x1b7b50db5927c8aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.637808:0:11097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e86ae903/0x1b7b50db5927c8aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521828.637860:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7896a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2361:x1875400799107200:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 Request processed in 8883us (9114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521828.637869:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 57 00000100:00100000:3.0:1788521828.641529:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521828.641641:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799107584 00000100:00100000:1.0:1788521828.641650:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799107584 00000100:00100000:1.0:1788521828.641739:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 186 00000100:00100000:1.0:1788521828.641749:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+17:11501:x1875400799107584:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788521828.641828:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927c8b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.641870:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927c8b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.641889:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927c8b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.642075:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c8b8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.642085:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c872 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c25 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.642093:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c8b8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.642122:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c872 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c25 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.642179:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c872 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c25 expref: 18 pid: 5835 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521828.642193:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb3f5a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1875400816925696:192.168.206.48@tcp:104: 00000100:00100000:1.0:1788521828.642260:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fad804a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521828.646437:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb3f5a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1875400816925696:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788521828.646534:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c8b8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521828.649437:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521828.649899:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799107712 00000100:00100000:3.0:1788521828.649910:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799107712 00010000:00010000:3.0:1788521828.649962:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c872 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c25 expref: 19 pid: 5835 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521828.650013:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 72 00000100:00100000:3.0:1788521828.650025:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+19:2364:x1875400799107712:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521828.650039:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521828.650045:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c872 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c25 expref: 19 pid: 5835 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.650066:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c872 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c25 expref: 19 pid: 5835 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.650087:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c872 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c25 expref: 19 pid: 5835 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.651380:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff996fa0d5c600) 00010000:00010000:3.0:1788521828.651387:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c8b8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.651398:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c8b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.651406:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c8b8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.652051:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521828.652121:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+18:2364:x1875400799107712:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 2094us (2701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521828.652132:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 72 00010000:00010000:3.0:1788521828.652213:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c8b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.652222:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c8b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788521828.653051:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1788521828.653243:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1788521828.653288:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1788521828.653384:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad929880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1875400816925824:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788521828.653462:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521828.653491:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f91285540 going to sleep for 11 seconds 00000100:00100000:0.0:1788521828.654741:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816925824 00000100:00100000:0.0:1788521828.654752:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816925824 00000100:00100000:0.0:1788521828.654799:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788521828.654808:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1875400816925824:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788521828.654921:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1875400816925824:12345-0@lo:1000:mdt00_000.0 Request processed in 113us (1458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521828.654929:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788521828.655056:0:5833:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1788521828.655062:0:5833:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff996fad92bb80, transno 4294967315 00000100:00100000:2.0:1788521828.655078:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad929880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1875400816925824:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788521828.655628:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1788521828.655707:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad929880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1875400816925952:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788521828.655750:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521828.655783:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f91285840 going to sleep for 11 seconds 00000100:00100000:0.0:1788521828.656033:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816925952 00000100:00100000:0.0:1788521828.656040:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816925952 00000100:00100000:0.0:1788521828.656073:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788521828.656082:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadb3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5833:x1875400816925952:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788521828.656272:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadb3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5833:x1875400816925952:12345-0@lo:1000:mdt00_000.0 Request processed in 190us (520us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788521828.656280:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788521828.656310:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad929880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1875400816925952:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788521828.656345:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c8b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.656354:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c8b8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.656361:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c8b8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.656366:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d4000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521828.656371:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c8b8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.656380:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c8b8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.656397:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff996fa0d5c600) 00010000:00010000:2.0:1788521828.656401:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788521828.656405:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c8b8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.656411:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4000/0x1b7b50db5927c8b8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.656468:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c7ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.656475:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c7ed lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.656481:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c7ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.656486:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490ac00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521828.656490:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c7ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.656496:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c7ed lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.656504:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996fb19efb00) 00010000:00010000:2.0:1788521828.656507:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788521828.656511:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c7ed lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.656517:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927c7ed lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.656535:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c8bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.656548:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927c809 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c09 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.656558:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c8bf lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.656589:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927c809 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c09 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521828.656610:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927c809 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c09 expref: 21 pid: 5834 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521828.656621:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb42db100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1875400816926080:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788521828.656695:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f91285840 going to sleep for 11 seconds 00000100:00100000:2.0:1788521828.662482:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521828.662486:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb42db100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1875400816926080:192.168.206.48@tcp:104: 00010000:00010000:0.0:1788521828.662516:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c8bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521828.662665:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799107840 00000100:00100000:3.0:1788521828.662672:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799107840 00010000:00010000:3.0:1788521828.662704:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927c809 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c09 expref: 22 pid: 5834 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521828.662786:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 73 00000100:00100000:3.0:1788521828.662796:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadfcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+22:2363:x1875400799107840:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521828.662820:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521828.662827:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927c809 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c09 expref: 22 pid: 5834 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.662846:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927c809 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c09 expref: 22 pid: 5834 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.662866:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927c809 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c09 expref: 22 pid: 5834 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.662880:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996fb19efb00) 00010000:00010000:3.0:1788521828.662885:0:7633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c8bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.662893:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c8bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.662900:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c8bf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521828.662927:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521828.662979:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadfcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+21:2363:x1875400799107840:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 185us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521828.662990:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 73 00010000:00010000:0.0:1788521828.663041:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c8bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.663049:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c8bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.663060:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c8bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.663066:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c8bf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.663073:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c8bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.663079:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490bc00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521828.663083:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c8bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.663091:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c8bf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.663099:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996fb19efb00) 00010000:00010000:0.0:1788521828.663109:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521828.663113:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c8bf lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.663119:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c8bf lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.663128:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927c8b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.663134:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927c8b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.663159:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927c8b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.663164:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521828.663167:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927c8b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.663173:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927c8b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.663180:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996fb19efb00) 00010000:00010000:0.0:1788521828.663182:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788521828.663185:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927c8b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.663191:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927c8b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521828.663395:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+20:11501:x1875400799107584:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 21646us (21875us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1788521828.663412:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 186 00000020:00080000:0.0:1788521828.663416:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788521828.663493:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788521828.663498:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788521828.663980:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788521828.663992:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788521828.665322:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521828.665640:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799108096 00000100:00100000:0.0:1788521828.665650:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799108096 00000100:00100000:0.0:1788521828.665703:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 50 00000100:00100000:0.0:1788521828.665714:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f97fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+20:11501:x1875400799108096:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788521828.666834:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788521828.667329:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1788521828.667384:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c8c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.667401:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c8c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.667413:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c8c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.667432:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c8c6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.667439:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c8c6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.667446:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c8c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521828.667477:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788521828.667510:0:7631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521828.667517:0:7631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c8c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.667531:0:7631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000800 already unused, calling callback (ffffffffc16c14f0) 00000100:00100000:0.0:1788521828.667715:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f97fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+22:11501:x1875400799108096:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 2000us (2393us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1788521828.667736:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 50 00000020:00080000:0.0:1788521828.667742:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788521828.667828:0:7631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c8c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.667839:0:7631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c8c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.667867:0:7631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff996f83d6d000) 00010000:00010000:1.0:1788521828.667871:0:7631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788521828.667876:0:7631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c8c6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.667882:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c8c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521828.667899:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521828.667902:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521828.667904:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788521829.000303:0:12509:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788521829.000313:0:12509:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788521829.000354:0:12509:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1788521829.000361:0:12509:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788521829.180571:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521829.180843:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799108352 00000100:00100000:0.0:1788521829.180854:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799108352 00000100:00080000:2.0:1788521829.180962:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521829.181493:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 187 00000100:00100000:0.0:1788521829.181506:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+22:11520:x1875400799108352:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1788521829.181530:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521829.181551:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c8cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00c41 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.181655:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001e00/0x1b7b50db5927c8d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.181672:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001e00/0x1b7b50db5927c8d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.181688:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001e00/0x1b7b50db5927c8d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521829.181699:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788521829.181811:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c8cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c41 expref: 25 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.181826:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001e00/0x1b7b50db5927c8d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c41 expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.181834:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:0.0:1788521829.181837:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788521829.181846:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4001e00, rc 0) 00000100:00100000:0.0:1788521829.181901:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+24:11520:x1875400799108352:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 399us (1340us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1788521829.181908:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 187 00000100:00100000:2.0:1788521829.185027:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521829.187663:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799108480 00000100:00100000:2.0:1788521829.187677:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799108480 00000100:00100000:2.0:1788521829.187751:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 188 00000100:00100000:2.0:1788521829.187763:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+24:11520:x1875400799108480:12345-192.168.206.48@tcp:34:lfs.0 00010000:00010000:2.0:1788521829.187843:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c8e2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.187862:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c8e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.187874:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c8e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.187890:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c8e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.187911:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c8e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.187918:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c8e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.188138:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c8f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.188169:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.188176:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788521829.188216:0:10083:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.188230:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c8e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.188236:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c8e2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.188243:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c8e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.188249:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490aa00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521829.188254:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c8e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.188262:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c8e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.188281:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:2.0:1788521829.188284:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521829.188289:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c8e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.188295:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c8e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.188307:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c8e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.188313:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c8e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.188320:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c8e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.188325:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490a200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521829.188329:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c8e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.188333:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c8e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.188339:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff996fb19efd00) 00010000:00010000:2.0:1788521829.188341:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521829.188344:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c8e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.188349:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927c8e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.188374:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.188380:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c8f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.188386:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c8f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.188391:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490b600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521829.188394:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c8f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.188399:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c8f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.188407:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996fb19ef300) 00010000:00010000:2.0:1788521829.188409:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521829.188412:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c8f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.188431:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927c8f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521829.189618:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+24:11520:x1875400799108480:12345-192.168.206.48@tcp:34:lfs.0 Request processed in 1849us (4592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521829.189630:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 188 00000100:00100000:2.0:1788521829.253939:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521829.254019:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799108736 00000100:00100000:3.0:1788521829.254030:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799108736 00000100:00100000:3.0:1788521829.254094:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 189 00000100:00100000:3.0:1788521829.254106:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb45a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+24:11523:x1875400799108736:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521829.254187:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521829.254209:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c8f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00c48 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.254285:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c8fe lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.254299:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c8fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.254312:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c8fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.254329:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c905 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.254336:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.254343:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.254811:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c90c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.254821:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c90c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.254829:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c90c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521829.254838:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788521829.255062:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c8fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.255069:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c8fe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.255075:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c8fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.255080:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392de00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521829.255085:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c8fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.255093:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c8fe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.255106:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:3.0:1788521829.255109:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521829.255114:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c8fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.255120:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927c8fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.255132:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.255137:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c905 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.255385:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c905 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.255391:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392c800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521829.255402:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c905 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.255409:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c905 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.255428:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff996f8687e500) 00010000:00010000:3.0:1788521829.255432:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521829.255435:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c905 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.255441:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927c905 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.255986:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927c8f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c48 expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.256017:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c90c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c48 expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.256025:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687ee00) 00010000:00010000:2.0:1788521829.256027:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521829.256029:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392c400, rc 0) 00000100:00100000:2.0:1788521829.256104:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb45a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+26:11523:x1875400799108736:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 2000us (2172us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1788521829.256111:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 189 00000100:00100000:2.0:1788521829.264124:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521829.264200:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799108864 00000100:00100000:0.0:1788521829.264209:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799108864 00000100:00100000:0.0:1788521829.264267:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 190 00000100:00100000:0.0:1788521829.264277:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb45a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+26:11523:x1875400799108864:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:0.0:1788521829.264341:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c91a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.264358:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c91a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.264369:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c91a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.264395:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c91a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.264402:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c91a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.264409:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c91a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.264415:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521829.264432:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c91a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.264439:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c91a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.264465:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687ee00) 00010000:00010000:0.0:1788521829.264467:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788521829.264472:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c91a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.264479:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c91a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521829.264557:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb45a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+26:11523:x1875400799108864:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 282us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521829.264565:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 190 00000100:00100000:1.0:1788521829.272674:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521829.272770:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799109120 00000100:00100000:3.0:1788521829.272779:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799109120 00000100:00100000:3.0:1788521829.272838:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 51 00000100:00100000:3.0:1788521829.272847:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+26:11523:x1875400799109120:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:3.0:1788521829.273330:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+27:11523:x1875400799109120:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 483us (663us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788521829.273338:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 51 00000100:00100000:3.0:1788521829.309495:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521829.309801:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799109376 00000100:00100000:0.0:1788521829.309813:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799109376 00000100:00100000:0.0:1788521829.309884:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 191 00000100:00100000:0.0:1788521829.309895:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+27:11057:x1875400799109376:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:0.0:1788521829.309918:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521829.309937:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c921 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00c4f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.310044:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000e00/0x1b7b50db5927c928 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.310060:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c90c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c48 expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.310070:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000e00/0x1b7b50db5927c928 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.310105:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c90c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c48 expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.310139:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c90c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c48 expref: 28 pid: 5834 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521829.310374:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7895c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875400816926208:192.168.206.48@tcp:104: 00000100:00100000:1.0:1788521829.310548:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f91285d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521829.314032:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7895c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875400816926208:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788521829.314064:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000e00/0x1b7b50db5927c928 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521829.320183:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521829.321469:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799109504 00000100:00100000:0.0:1788521829.321483:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799109504 00010000:00010000:0.0:1788521829.321530:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c90c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c48 expref: 29 pid: 5834 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521829.321572:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 74 00000100:00100000:0.0:1788521829.321581:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc420700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+29:2364:x1875400799109504:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521829.321597:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521829.321602:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c90c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c48 expref: 29 pid: 5834 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.321621:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c90c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c48 expref: 29 pid: 5834 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.321642:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927c90c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c48 expref: 29 pid: 5834 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.321656:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687ee00) 00010000:00010000:0.0:1788521829.321661:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000e00/0x1b7b50db5927c928 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.321671:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000e00/0x1b7b50db5927c928 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.321693:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000e00/0x1b7b50db5927c928 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.321723:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521829.321793:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc420700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+28:2364:x1875400799109504:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 212us (1658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521829.321800:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 74 00010000:00010000:1.0:1788521829.321877:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000e00/0x1b7b50db5927c928 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.321891:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000e00/0x1b7b50db5927c928 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521829.321909:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788521829.322114:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927c921 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c4f expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.322132:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000e00/0x1b7b50db5927c928 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c4f expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.322188:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687ee00) 00010000:00010000:1.0:1788521829.322192:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788521829.322194:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4000e00, rc 0) 00000100:00100000:1.0:1788521829.322227:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+28:11057:x1875400799109376:12345-192.168.206.48@tcp:101:bash.0 Request processed in 12333us (12740us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788521829.322234:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 191 00000100:00100000:2.0:1788521829.326617:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521829.326700:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799109760 00000100:00100000:0.0:1788521829.326709:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799109760 00000100:00100000:0.0:1788521829.326766:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 192 00000100:00100000:0.0:1788521829.326777:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb45a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+28:11057:x1875400799109760:12345-192.168.206.48@tcp:36:bash.0 00010000:00010000:0.0:1788521829.327059:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c936 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.327076:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c936 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.327088:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c936 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788521829.327136:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1788521829.327207:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064dfb2d3 reply state 0000000051eefd46 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c936 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521829.327217:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788521829.327266:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1788521829.327353:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb45a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+32:11057:x1875400799109760:12345-192.168.206.48@tcp:36:bash.0 Request processed in 578us (745us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1788521829.327360:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 192 00000020:00080000:0.0:1788521829.327377:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788521829.330307:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c936 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.330324:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c936 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.330331:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c936 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.330347:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521829.330352:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c936 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.330360:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c936 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.330375:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687ee00) 00010000:00010000:3.0:1788521829.330378:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521829.330383:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c936 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.330388:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927c936 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521829.331326:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521829.331475:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799109888 00000100:00100000:0.0:1788521829.331484:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799109888 00000100:00100000:0.0:1788521829.331526:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 193 00000100:00100000:0.0:1788521829.331536:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc6fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+31:11057:x1875400799109888:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:0.0:1788521829.331558:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521829.331576:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001c00/0x1b7b50db5927c93d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00c56 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.331632:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001c00/0x1b7b50db5927c93d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c56 expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.331648:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001c00/0x1b7b50db5927c93d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c56 expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.331669:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687ee00) 00010000:00010000:0.0:1788521829.331672:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788521829.331676:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4001c00, rc 0) 00000100:00100000:0.0:1788521829.331727:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc6fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+32:11057:x1875400799109888:12345-192.168.206.48@tcp:101:bash.0 Request processed in 192us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521829.331734:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 193 00000100:00100000:1.0:1788521829.337547:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521829.337648:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799110016 00000100:00100000:2.0:1788521829.337657:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799110016 00000100:00100000:2.0:1788521829.337718:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 58 00000100:00100000:2.0:1788521829.337728:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+7:11057:x1875400799110016:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:2.0:1788521829.337758:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521829.337777:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025c4db71/0x1b7b50db5927c944 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00c5d expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788521829.337803:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9aad64, atime: 0x6a9aad62, ctime: 0x6a9aad64, blocks: 0xb 00010000:00010000:2.0:1788521829.337823:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=329s v=(0 0) 00010000:00010000:2.0:1788521829.337827:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521829.337836:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025c4db71/0x1b7b50db5927c944 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c5d expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.338132:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000025c4db71/0x1b7b50db5927c944 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c5d expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.338184:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490a200, rc 0) 00000100:00100000:2.0:1788521829.338238:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+8:11057:x1875400799110016:12345-192.168.206.48@tcp:101:bash.0 Request processed in 511us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521829.338246:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 58 00000100:00100000:3.0:1788521829.340287:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521829.340499:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799110144 00000100:00100000:2.0:1788521829.340508:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799110144 00002000:00010000:2.0:1788521829.340545:0:6695:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1788521829.340550:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff996fbc421f80 with x1875400799110144 ext(0->18446744073709551615) 00002000:00010000:2.0:1788521829.340560:0:6695:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996fbc421f80. 00000100:00100000:2.0:1788521829.340594:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:2.0:1788521829.340604:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+8:2361:x1875400799110144:12345-192.168.206.48@tcp:10:bash.0 00002000:00010000:2.0:1788521829.341122:0:6695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788521829.341126:0:6695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788521828 -> 1788521829 00002000:00010000:2.0:1788521829.341129:0:6695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788521826 -> 1788521826 00002000:00010000:2.0:1788521829.341131:0:6695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788521828 -> 1788521829 00002000:00010000:2.0:1788521829.341133:0:6695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788521829.341324:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+9:2361:x1875400799110144:12345-192.168.206.48@tcp:10:bash.0 Request processed in 720us (1043us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788521829.341332:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 5 00002000:00010000:2.0:1788521829.341335:0:6695:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1788521829.341338:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff996fbc421f80 with x1875400799110144 ext(0->18446744073709551615) 00002000:00010000:2.0:1788521829.341355:0:6695:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996fbc421f80. 00000100:00100000:3.0:1788521829.439652:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521829.439752:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799110272 00000100:00100000:0.0:1788521829.439762:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799110272 00000100:00100000:0.0:1788521829.439822:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 194 00000100:00100000:0.0:1788521829.439833:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+32:11537:x1875400799110272:12345-192.168.206.48@tcp:34:lfs.0 00010000:00010000:0.0:1788521829.439903:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c94b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.439941:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c94b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.439955:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c94b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.439972:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c952 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.439979:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.439985:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.440258:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927c959 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.440267:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927c959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.440273:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927c959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788521829.440309:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927c959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.440319:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c94b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.440325:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c94b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.440341:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c94b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.440346:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521829.440351:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c94b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.440357:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c94b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.440368:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:0.0:1788521829.440371:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521829.440375:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c94b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.440381:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c94b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.440391:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.440396:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c952 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.440401:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c952 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.440405:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4001000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521829.440408:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c952 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.440433:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c952 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.440441:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff996f83d6dd00) 00010000:00010000:0.0:1788521829.440443:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521829.440446:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c952 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.440451:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c952 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.440463:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927c959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.440469:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927c959 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.440474:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927c959 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.440479:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521829.440481:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927c959 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.440487:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927c959 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.440494:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687ee00) 00010000:00010000:0.0:1788521829.440496:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521829.440499:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927c959 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.440514:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927c959 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521829.440593:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+32:11537:x1875400799110272:12345-192.168.206.48@tcp:34:lfs.0 Request processed in 760us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521829.440600:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 194 00010000:00010000:3.0:1788521829.518345:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521829.529542:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521829.529658:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799110528 00000100:00100000:0.0:1788521829.529783:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799110528 00000100:00100000:0.0:1788521829.529842:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 195 00000100:00100000:0.0:1788521829.529853:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+32:11540:x1875400799110528:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1788521829.529872:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521829.529893:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927c960 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00c64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.529969:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c967 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.529983:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c967 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.529995:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c967 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.530009:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c96e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.530017:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c96e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.530039:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c96e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.530312:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001200/0x1b7b50db5927c975 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.530322:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001200/0x1b7b50db5927c975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.530330:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001200/0x1b7b50db5927c975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521829.530340:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788521829.530441:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c967 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.530450:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c967 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.530457:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c967 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.530463:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4001000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521829.530467:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c967 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.530474:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c967 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.530485:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:0.0:1788521829.530488:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521829.530498:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c967 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.530504:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927c967 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.530515:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c96e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.530521:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c96e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.530526:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c96e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.530531:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521829.530534:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c96e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.530539:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c96e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.530546:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff996f83d6dd00) 00010000:00010000:0.0:1788521829.530548:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521829.530551:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c96e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.530557:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927c96e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.530594:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927c960 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c64 expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.530618:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001200/0x1b7b50db5927c975 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c64 expref: 34 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.530626:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687ee00) 00010000:00010000:0.0:1788521829.530628:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788521829.530631:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4001200, rc 0) 00000100:00100000:0.0:1788521829.531045:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+34:11540:x1875400799110528:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 1192us (1510us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1788521829.531054:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 195 00000100:00100000:3.0:1788521829.535373:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521829.535478:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799110656 00000100:00100000:1.0:1788521829.535489:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799110656 00000100:00100000:1.0:1788521829.535598:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 196 00000100:00100000:1.0:1788521829.535610:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+34:11540:x1875400799110656:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:1.0:1788521829.535695:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c983 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.535713:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000e00/0x1b7b50db5927c928 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c4f expref: 34 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.535755:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c983 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.535790:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000e00/0x1b7b50db5927c928 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c4f expref: 34 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.535811:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000e00/0x1b7b50db5927c928 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c4f expref: 34 pid: 5835 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521829.535824:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc426d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1875400816926336:192.168.206.48@tcp:104: 00000100:00100000:1.0:1788521829.535906:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fad804c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788521829.540806:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521829.540880:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc426d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1875400816926336:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788521829.540912:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c983 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521829.541108:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799110912 00000100:00100000:0.0:1788521829.541115:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799110912 00000100:00100000:0.0:1788521829.541197:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 52 00000100:00100000:0.0:1788521829.541215:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+35:5597:x1875400799110912:12345-192.168.206.48@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788521829.541791:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+36:5597:x1875400799110912:12345-192.168.206.48@tcp:35:ldlm_bl.0 Request processed in 576us (992us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1788521829.541799:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 52 00000100:00100000:3.0:1788521829.550008:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521829.550179:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799111040 00000100:00100000:2.0:1788521829.550189:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799111040 00010000:00010000:2.0:1788521829.550308:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000e00/0x1b7b50db5927c928 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c4f expref: 36 pid: 5835 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521829.550355:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 75 00000100:00100000:2.0:1788521829.550365:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f856e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+36:2364:x1875400799111040:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521829.550381:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521829.550388:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000e00/0x1b7b50db5927c928 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c4f expref: 36 pid: 5835 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.550409:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000e00/0x1b7b50db5927c928 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c4f expref: 36 pid: 5835 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.550506:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000e00/0x1b7b50db5927c928 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c4f expref: 36 pid: 5835 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.550524:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687ee00) 00010000:00010000:2.0:1788521829.550529:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c983 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.550537:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.550545:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c983 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.550625:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521829.550697:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f856e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+35:2364:x1875400799111040:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 333us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521829.550706:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 75 00010000:00010000:1.0:1788521829.552425:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.552440:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.552537:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.552545:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c983 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.552552:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c983 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.552573:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d4400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521829.552578:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c983 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.552585:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c983 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.552600:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687ee00) 00010000:00010000:1.0:1788521829.552603:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788521829.552608:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c983 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.552614:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c983 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521829.552829:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+34:11540:x1875400799110656:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 17217us (17460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521829.552839:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 196 00000100:00100000:3.0:1788521829.561546:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521829.561672:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799111296 00000100:00100000:0.0:1788521829.561681:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799111296 00000100:00100000:0.0:1788521829.561738:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 53 00000100:00100000:0.0:1788521829.561748:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+34:11540:x1875400799111296:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:0.0:1788521829.561991:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+35:11540:x1875400799111296:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 244us (453us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1788521829.561998:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 53 00000100:00100000:3.0:1788521829.632682:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521829.632994:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799111552 00000100:00100000:1.0:1788521829.633003:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799111552 00000100:00100000:1.0:1788521829.633063:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 197 00000100:00100000:1.0:1788521829.633072:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+35:11551:x1875400799111552:12345-192.168.206.48@tcp:101:cat.0 00010000:00010000:1.0:1788521829.633092:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521829.633192:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c98a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00c6b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.633263:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c991 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.633296:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c991 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.633307:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c991 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.633323:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c998 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.633330:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c998 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.633337:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c998 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.633614:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c99f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.633623:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c99f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.633630:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c99f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521829.633640:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788521829.633726:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c991 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.633734:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c991 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.633741:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c991 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.633753:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521829.633757:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c991 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.633765:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c991 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.633776:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:1.0:1788521829.633779:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521829.633784:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c991 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.633790:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c991 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.633808:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c998 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.633815:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c998 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.633821:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c998 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.633825:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d4400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521829.633828:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c998 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.633834:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c998 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.633864:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff996fa0d5c200) 00010000:00010000:1.0:1788521829.633866:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521829.633869:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c998 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.633874:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c998 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.633913:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927c98a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c6b expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.633927:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c99f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c6b expref: 37 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.633933:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687ee00) 00010000:00010000:1.0:1788521829.633936:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521829.633938:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d5400, rc 0) 00000100:00100000:1.0:1788521829.634004:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+37:11551:x1875400799111552:12345-192.168.206.48@tcp:101:cat.0 Request processed in 932us (1331us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788521829.634012:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 197 00000100:00100000:1.0:1788521829.640716:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521829.640785:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799111808 00000100:00100000:0.0:1788521829.640808:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799111808 00000100:00100000:0.0:1788521829.640872:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 54 00000100:00100000:0.0:1788521829.640882:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+37:11551:x1875400799111808:12345-192.168.206.48@tcp:35:cat.0 00000100:00100000:0.0:1788521829.641129:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+38:11551:x1875400799111808:12345-192.168.206.48@tcp:35:cat.0 Request processed in 247us (422us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1788521829.641136:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 54 00000100:00100000:3.0:1788521829.665254:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521829.665328:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799112064 00000100:00100000:2.0:1788521829.665340:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799112064 00000100:00100000:2.0:1788521829.665469:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 198 00000100:00100000:2.0:1788521829.665481:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+38:11552:x1875400799112064:12345-192.168.206.48@tcp:36:rm.0 00010000:00010000:2.0:1788521829.665542:0:10083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788521829.665571:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5400/0x1b7b50db5927c99f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c6b expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.665598:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001200/0x1b7b50db5927c975 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c64 expref: 37 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.665617:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001c00/0x1b7b50db5927c93d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c56 expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.665629:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996f8687ee00) 00010000:00010000:2.0:1788521829.665641:0:10083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521829.665663:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c9ad lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.665678:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c9ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.665690:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c9ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.665707:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c9b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.665728:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c9b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.665735:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c9b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.665979:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927c9bb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.665988:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927c9bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.665995:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927c9bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788521829.666596:0:10083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1788521829.666607:0:10083:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 329651463576ns, next at 330651460093ns, rc = 0 00010000:00010000:2.0:1788521829.666668:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c9c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.666678:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c9c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.666686:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c9c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.666694:0:10083:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c9c2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.666700:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c9c2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.666717:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c9c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.666746:0:10083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521829.666767:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927c9bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.666774:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927c9bb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.666780:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927c9bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.666785:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490b000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521829.666790:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927c9bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.666797:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927c9bb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.666807:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996fb19ef800) 00010000:00010000:2.0:1788521829.666810:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788521829.666814:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927c9bb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.666820:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927c9bb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.666837:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c9ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.666842:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c9ad lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.666853:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c9ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.666858:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490aa00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521829.666861:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c9ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.666868:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c9ad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.666877:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:2.0:1788521829.666879:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521829.666882:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c9ad lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.666888:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927c9ad lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788521829.666898:0:10083:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ed81047 reply state 00000000b987a32b transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c9b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521829.666906:0:10083:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788521829.666909:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521829.666915:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c9c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.666920:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490a400 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521829.666923:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c9c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.666940:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c9c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.666948:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996fb19ef800) 00010000:00010000:0.0:1788521829.666950:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788521829.666953:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c9c2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.666958:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927c9c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.666970:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521829.666972:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521829.666974:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521829.666988:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+37:11552:x1875400799112064:12345-192.168.206.48@tcp:36:rm.0 Request processed in 1508us (1755us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788521829.666996:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 198 00010000:00010000:0.0:1788521829.670583:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c9b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.670617:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c9b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.670625:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c9b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.670631:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490bc00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521829.670636:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c9b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.670645:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c9b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.670660:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff996fb19efe00) 00010000:00010000:0.0:1788521829.670662:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521829.670667:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c9b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.670673:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927c9b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521829.711457:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3305:1875400816926464:0@lo:400:kworker.0 00000100:00100000:0.0:1788521829.711507:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875400816926720:0@lo:400:kworker.0 00000100:00100000:3.0:1788521829.711526:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521829.711551:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521829.711576:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875400816926976:0@lo:400:kworker.0 00000100:00100000:0.0:1788521829.711586:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788521829.711596:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875400816926592:0@lo:400:kworker.0 00000100:00100000:3.0:1788521829.711602:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521829.711627:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521829.711639:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788521829.711648:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816926848:0@lo:400:kworker.0 00000100:00100000:0.0:1788521829.711652:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb4a65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816927104:0@lo:400:kworker.0 00000100:00100000:0.0:1788521829.711697:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816926720 00000100:00100000:3.0:1788521829.711700:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521829.711747:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816926464 00000100:00100000:3.0:1788521829.711754:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816926464 00000100:00100000:1.0:1788521829.711756:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816926976 00000100:00100000:1.0:1788521829.711762:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816926976 00000100:00100000:3.0:1788521829.711802:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788521829.711809:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816926592 00000100:00100000:3.0:1788521829.711813:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3305:x1875400816926464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521829.711815:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816926592 00000100:00100000:1.0:1788521829.711836:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788521829.711845:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875400816926976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521829.711862:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3305:x1875400816926464:12345-0@lo:400:kworker.0 Request processed in 51us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521829.711891:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875400816926976:12345-0@lo:400:kworker.0 Request processed in 47us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521829.711905:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788521829.711922:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788521829.711928:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875400816926592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521829.712517:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788521829.712552:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816926848 00000100:00100000:3.0:1788521829.712557:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816926848 00000100:00100000:3.0:1788521829.712583:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788521829.712590:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875400816926848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521829.712622:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875400816926848:12345-0@lo:400:kworker.0 Request processed in 32us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521829.712627:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788521829.712661:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816926848:0@lo:400:kworker.0 00000100:00100000:3.0:1788521829.712670:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3305:1875400816926464:0@lo:400:kworker.0 00000100:00100000:3.0:1788521829.712678:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875400816926976:0@lo:400:kworker.0 00000100:00080000:3.0:1788521829.712737:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521829.712761:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521829.712796:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875400816926592:0@lo:400:kworker.0 00000100:00100000:3.0:1788521829.712819:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816927104 00000100:00100000:3.0:1788521829.712823:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816927104 00000100:00100000:3.0:1788521829.712843:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788521829.712857:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1875400816927104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521829.713238:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816926720 00000100:00080000:0.0:1788521829.713259:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521829.713287:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788521829.713295:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875400816926720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521829.713446:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875400816926592:12345-0@lo:400:kworker.0 Request processed in 29us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521829.713453:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788521829.713792:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1875400816927104:12345-0@lo:400:kworker.0 Request processed in 934us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521829.713799:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788521829.716912:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb4a65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816927104:0@lo:400:kworker.0 00000100:00100000:2.0:1788521829.716930:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875400816926720:0@lo:400:kworker.0 00000100:00100000:0.0:1788521829.717631:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875400816926720:12345-0@lo:400:kworker.0 Request processed in 3366us (5110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521829.717644:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788521829.732085:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521829.732381:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799112320 00000100:00100000:1.0:1788521829.732391:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799112320 00000100:00100000:1.0:1788521829.732470:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 199 00000100:00100000:1.0:1788521829.732480:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+36:11558:x1875400799112320:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:1.0:1788521829.732502:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521829.732522:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c9c9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00c72 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.732636:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c9d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.732652:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c9d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.732663:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c9d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.732678:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c9d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.732685:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c9d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.732711:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c9d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788521829.733627:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1788521829.733787:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c9de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.733798:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c9de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.734075:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c9de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.734113:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c9d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.734121:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c9d0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.734128:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c9d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.734133:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521829.734138:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c9d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.734170:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c9d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.734183:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:1.0:1788521829.734186:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521829.734199:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c9d0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.734206:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927c9d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788521829.734221:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000129ee806 reply state 00000000c328f36f transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c9d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521829.734230:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788521829.734261:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927c9c9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c72 expref: 39 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.734276:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c9de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c72 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.734297:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fa0d5c100) 00010000:00010000:1.0:1788521829.734300:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521829.734303:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d4a00, rc 0) 00000100:00100000:1.0:1788521829.734441:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+39:11558:x1875400799112320:12345-192.168.206.48@tcp:101:bash.0 Request processed in 1962us (2364us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1788521829.734449:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 199 00010000:00010000:0.0:1788521829.743865:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c9d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.743898:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c9d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.743907:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c9d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.743913:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521829.743917:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c9d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.743935:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c9d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.743952:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff996fa0d5c200) 00010000:00010000:0.0:1788521829.743955:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521829.743960:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c9d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.743967:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927c9d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521829.749185:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521829.749770:0:12322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799112448 00000100:00100000:0.0:1788521829.749779:0:12322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799112448 00000100:00100000:0.0:1788521829.749847:0:12322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 59 00000100:00100000:0.0:1788521829.749857:0:12322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2364:x1875400799112448:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:0.0:1788521829.749924:0:12322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521829.749945:0:12322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7a6be3d/0x1b7b50db5927c9ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00c79 expref: -99 pid: 12322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788521829.749971:0:12322:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788521829.749989:0:12322:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=329s v=(0 0) 00010000:00010000:0.0:1788521829.749994:0:12322:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521829.750004:0:12322:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a6be3d/0x1b7b50db5927c9ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c79 expref: 8 pid: 12322 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.750022:0:12322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d7a6be3d/0x1b7b50db5927c9ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c79 expref: 8 pid: 12322 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.750039:0:12322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4001000, rc 0) 00000100:00100000:0.0:1788521829.750093:0:12322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+8:2364:x1875400799112448:12345-192.168.206.48@tcp:101:bash.0 Request processed in 237us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521829.750100:0:12322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 59 00000100:00080000:3.0:1788521829.752322:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788521829.759038:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521829.759808:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799112576 00000100:00100000:2.0:1788521829.759832:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799112576 00000100:00100000:2.0:1788521829.759900:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 60 00000100:00100000:2.0:1788521829.759909:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+8:11558:x1875400799112576:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:2.0:1788521829.759926:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521829.759943:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c9f3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00c80 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.759974:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7a6be3d/0x1b7b50db5927c9ec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c79 expref: 9 pid: 12322 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.759983:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521829.759987:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521829.759992:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c9f3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c80 expref: 9 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.760025:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d7a6be3d/0x1b7b50db5927c9ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c79 expref: 9 pid: 12322 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.760046:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d7a6be3d/0x1b7b50db5927c9ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c79 expref: 9 pid: 12322 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521829.760059:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbfc2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1875400816927232:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788521829.760178:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90f5a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521829.766455:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521829.766662:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799112704 00000100:00100000:3.0:1788521829.766672:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799112704 00010000:00010000:3.0:1788521829.766725:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a6be3d/0x1b7b50db5927c9ec lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c79 expref: 10 pid: 12322 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521829.766766:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 76 00000100:00100000:3.0:1788521829.766776:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+10:2364:x1875400799112704:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521829.766791:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521829.766813:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d7a6be3d/0x1b7b50db5927c9ec lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c79 expref: 10 pid: 12322 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.766833:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d7a6be3d/0x1b7b50db5927c9ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c79 expref: 10 pid: 12322 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.766858:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521829.766863:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521829.766884:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c9f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c80 expref: 10 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.766914:0:7633:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c9f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c80 expref: 10 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.766951:0:7633:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c9f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c80 expref: 10 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521829.766965:0:7633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc423100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7633:1875400816927360:192.168.206.48@tcp:105: 00010000:00010000:2.0:1788521829.767200:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7a6be3d/0x1b7b50db5927c9ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c79 expref: 10 pid: 12322 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521829.767227:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbfc2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1875400816927232:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788521829.767251:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c9f3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c80 expref: 9 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.767262:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490aa00, rc 0) 00000100:00100000:3.0:1788521829.767339:0:7633:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb18d7300 going to sleep for 11 seconds 00000100:00100000:2.0:1788521829.769438:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+9:11558:x1875400799112576:12345-192.168.206.48@tcp:101:bash.0 Request processed in 9519us (10398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521829.769458:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 60 00000100:00100000:1.0:1788521829.776045:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521829.776173:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799112960 00000100:00100000:2.0:1788521829.776182:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799112960 00000100:00100000:2.0:1788521829.776229:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 55 00000100:00100000:2.0:1788521829.776239:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+38:11558:x1875400799112960:12345-192.168.206.48@tcp:35:bash.0 00000100:00100000:2.0:1788521829.776573:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+39:11558:x1875400799112960:12345-192.168.206.48@tcp:35:bash.0 Request processed in 334us (536us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788521829.776586:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 55 00000100:00100000:3.0:1788521829.777677:0:7633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc423100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7633:1875400816927360:192.168.206.48@tcp:105: 00010000:00010000:3.0:1788521829.777701:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521829.777748:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+8:2364:x1875400799112704:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 10973us (11306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521829.777757:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 76 00000100:00100000:1.0:1788521829.927558:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521829.927760:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799113088 00000100:00100000:3.0:1788521829.927771:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799113088 00000100:00100000:3.0:1788521829.927831:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 200 00000100:00100000:3.0:1788521829.927843:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+39:11574:x1875400799113088:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521829.927881:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521829.927902:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927c9fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00c87 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.927964:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927ca01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.927979:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927ca01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.928006:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927ca01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521829.928041:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788521829.928045:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788521829.928062:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927ca01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.928085:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927c9fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c87 expref: 41 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.928103:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927ca01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c87 expref: 40 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.928112:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:3.0:1788521829.928114:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788521829.928118:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392c800, rc 0) 00000100:00100000:3.0:1788521829.928235:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+40:11574:x1875400799113088:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 393us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521829.928241:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 200 00000100:00100000:1.0:1788521829.931789:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521829.931883:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799113344 00000100:00100000:2.0:1788521829.931891:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799113344 00000100:00100000:2.0:1788521829.931945:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 201 00000100:00100000:2.0:1788521829.931954:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+40:11574:x1875400799113344:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521829.931972:0:10083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521829.931993:0:10083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927ca08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00c8e expref: -99 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.932105:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927ca0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.932124:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927ca0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.932134:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927ca0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521829.932184:0:10083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788521829.932303:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927ca08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c8e expref: 43 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.932320:0:10083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927ca0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c8e expref: 42 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.932329:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fa0d5c100) 00010000:00010000:2.0:1788521829.932331:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521829.932335:0:10083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490bc00, rc 0) 00000100:00100000:2.0:1788521829.932390:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+42:11574:x1875400799113344:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 436us (609us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788521829.932396:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 201 00000100:00100000:2.0:1788521829.938330:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521829.938375:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521829.938472:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799113728 00000100:00100000:0.0:1788521829.938483:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799113728 00000100:00100000:0.0:1788521829.938546:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:0.0:1788521829.938556:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadfcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+42:2361:x1875400799113728:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521829.938588:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521829.938611:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927ca0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c8e expref: 42 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.938629:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fa0d5c100) 00010000:00010000:0.0:1788521829.938634:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521829.938688:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadfcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+41:2361:x1875400799113728:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 133us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521829.938695:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:3.0:1788521829.939139:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799113600 00000100:00100000:3.0:1788521829.939174:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799113600 00000100:00100000:3.0:1788521829.939210:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 202 00000100:00100000:3.0:1788521829.939219:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbfc2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+41:11574:x1875400799113600:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521829.939237:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521829.939251:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927ca1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00c95 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.939363:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927ca24 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.939377:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927ca24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.939387:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927ca24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521829.939398:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788521829.939526:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927ca1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c95 expref: 44 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.939541:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927ca24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c95 expref: 43 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.939548:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fa0d5c100) 00010000:00010000:3.0:1788521829.939550:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788521829.939553:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392da00, rc 0) 00000100:00100000:3.0:1788521829.939596:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbfc2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+43:11574:x1875400799113600:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 379us (1275us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788521829.939603:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 202 00000100:00100000:2.0:1788521829.947517:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521829.947645:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799113856 00000100:00100000:3.0:1788521829.947654:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799113856 00000100:00100000:3.0:1788521829.947718:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 61 00000100:00100000:3.0:1788521829.947729:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb791ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+8:2363:x1875400799113856:12345-192.168.206.48@tcp:1:lfs.0 00010000:00010000:3.0:1788521829.947780:0:11097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca4f2766/0x1b7b50db5927ca32 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.947807:0:11097:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c9f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c80 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.947816:0:11097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521829.947820:0:11097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521829.947825:0:11097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca4f2766/0x1b7b50db5927ca32 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.947881:0:11097:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c9f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c80 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.947905:0:11097:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c9f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c80 expref: 8 pid: 6690 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521829.947921:0:11097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc423100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11097:1875400816927488:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788521829.948002:0:11097:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fbc3c4480 going to sleep for 11 seconds 00000100:00100000:1.0:1788521829.953116:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521829.953255:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799113984 00000100:00100000:0.0:1788521829.953264:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799113984 00002000:00100000:0.0:1788521829.953310:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff996fbc427100 x1875400799113984/t0(0) o4->4bd13e8f-aac9-42ad-8625-a542705d6920@192.168.206.48@tcp:75/0 lens 504/0 e 0 to 0 dl 1788521840 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788521829.953321:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff996fbc427100 with x1875400799113984 ext(0->8) 00010000:00010000:0.0:1788521829.953330:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c9f3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c80 expref: 9 pid: 6690 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.953352:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c9f3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c80 expref: 9 pid: 6690 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788521829.953359:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff996fbc427100 00000100:00100000:0.0:1788521829.953389:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:0.0:1788521829.953399:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+9:2364:x1875400799113984:12345-192.168.206.48@tcp:4:lfs.0 00000100:00100000:3.0:1788521829.954013:0:11097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc423100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11097:1875400816927488:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788521829.954039:0:11097:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ca4f2766/0x1b7b50db5927ca32 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521829.956381:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+11:2364:x1875400799113984:12345-192.168.206.48@tcp:4:lfs.0 Request processed in 2972us (3262us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788521829.956427:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 3 00002000:00100000:0.0:1788521829.956441:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff996fbc427100 x1875400799113984/t4294967308(0) o4->4bd13e8f-aac9-42ad-8625-a542705d6920@192.168.206.48@tcp:75/0 lens 504/448 e 0 to 0 dl 1788521840 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788521829.956451:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff996fbc427100 with x1875400799113984 ext(0->8) 00010000:00010000:0.0:1788521829.956459:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c9f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c80 expref: 11 pid: 6690 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521829.956485:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c9f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c80 expref: 11 pid: 6690 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788521829.956492:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff996fbc427100 00000100:00100000:1.0:1788521829.962045:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521829.962128:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799114112 00000100:00100000:3.0:1788521829.962139:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799114112 00010000:00010000:3.0:1788521829.962212:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c9f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c80 expref: 11 pid: 6690 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521829.962264:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 77 00000100:00100000:3.0:1788521829.962273:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc425500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+11:2363:x1875400799114112:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521829.962289:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788521829.962308:0:5818:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788521829.962311:0:5818:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788521830 00002000:00010000:3.0:1788521829.962313:0:5818:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788521830 00002000:00010000:3.0:1788521829.962315:0:5818:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788521830 00010000:00010000:3.0:1788521829.962321:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c9f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c80 expref: 11 pid: 6690 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.962343:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c9f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c80 expref: 11 pid: 6690 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.962370:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033e1d75f/0x1b7b50db5927c9f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c80 expref: 11 pid: 6690 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.962386:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521829.962391:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521829.962397:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca4f2766/0x1b7b50db5927ca32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.962406:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca4f2766/0x1b7b50db5927ca32 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.962858:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521829.962938:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc425500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+10:2363:x1875400799114112:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 664us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521829.962946:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 77 00010000:00010000:1.0:1788521829.963450:0:11097:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ca4f2766/0x1b7b50db5927ca32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.963477:0:11097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca4f2766/0x1b7b50db5927ca32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.963507:0:11097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca4f2766/0x1b7b50db5927ca32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.963516:0:11097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca4f2766/0x1b7b50db5927ca32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.963523:0:11097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca4f2766/0x1b7b50db5927ca32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.963530:0:11097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392c400 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:1.0:1788521829.963664:0:11097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca4f2766/0x1b7b50db5927ca32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.963676:0:11097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca4f2766/0x1b7b50db5927ca32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.963691:0:11097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca4f2766/0x1b7b50db5927ca32 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521829.963699:0:11097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca4f2766/0x1b7b50db5927ca32 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521829.963777:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb791ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+9:2363:x1875400799113856:12345-192.168.206.48@tcp:1:lfs.0 Request processed in 16049us (16267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521829.963785:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 61 00000100:00100000:1.0:1788521829.970734:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521829.970973:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799114368 00000100:00100000:2.0:1788521829.970983:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799114368 00000100:00100000:2.0:1788521829.971040:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 56 00000100:00100000:2.0:1788521829.971050:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f97fd1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+43:11574:x1875400799114368:12345-192.168.206.48@tcp:35:lfs.0 00000004:00010000:2.0:1788521829.971112:0:5836:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927ca24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c95 expref: 43 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788521829.971428:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1788521829.971705:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1788521829.971978:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1788521829.972030:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927ca39 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.972046:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c9de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c72 expref: 47 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.972056:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927ca39 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.972088:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c9de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c72 expref: 47 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.972110:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c9de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c72 expref: 47 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521829.972124:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb791e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5836:1875400816927616:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788521829.975136:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90f5ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788521829.979107:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb791e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5836:1875400816927616:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788521829.979186:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927ca39 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521829.981176:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521829.981395:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799114496 00000100:00100000:3.0:1788521829.981405:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799114496 00010000:00010000:3.0:1788521829.981465:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c9de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c72 expref: 48 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521829.981506:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 78 00000100:00100000:3.0:1788521829.981517:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc424e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+48:2364:x1875400799114496:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521829.981531:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521829.981549:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c9de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c72 expref: 48 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.981570:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c9de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c72 expref: 48 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.981593:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927c9de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c72 expref: 48 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.981613:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fa0d5c100) 00010000:00010000:3.0:1788521829.981618:0:7633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927ca39 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.981646:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927ca39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.981655:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927ca39 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.981693:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521829.981746:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc424e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+47:2364:x1875400799114496:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 231us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521829.981753:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 78 00010000:00010000:2.0:1788521829.981866:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927ca39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.981875:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927ca39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788521829.981991:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1788521829.982211:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1788521829.982326:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb791fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1875400816927744:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788521829.982389:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521829.982433:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90f5a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521829.982496:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816927744 00000100:00100000:0.0:1788521829.982502:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816927744 00000100:00100000:0.0:1788521829.982543:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788521829.982551:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb791dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5836:x1875400816927744:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788521829.982625:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb791dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5836:x1875400816927744:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 74us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521829.982631:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788521829.982918:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb791fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1875400816927744:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788521829.983382:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1788521829.983455:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc423100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1875400816927872:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788521829.983490:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521829.983517:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f867596c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521829.983815:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816927872 00000100:00100000:2.0:1788521829.983821:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816927872 00000100:00100000:2.0:1788521829.983865:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788521829.983874:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5836:x1875400816927872:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788521829.984009:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5836:x1875400816927872:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 135us (518us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788521829.984016:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788521829.984667:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc423100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1875400816927872:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788521829.984732:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1788521829.984779:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927ca39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.984788:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927ca39 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.984794:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927ca39 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.984800:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490b600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521829.984804:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927ca39 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.984824:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927ca39 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.984840:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fa0d5c100) 00010000:00010000:3.0:1788521829.984843:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788521829.984848:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927ca39 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521829.984854:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927ca39 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788521829.985048:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788521829.985860:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1788521829.985929:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 329970785676ns, next at 330970781944ns, rc = 0 00000001:00080000:3.0:1788521829.985939:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1788521829.986000:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fa0d5c100) 00010000:00010000:3.0:1788521829.986005:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788521829.986014:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927ca24 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c95 expref: 51 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521829.986242:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f97fd1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+50:11574:x1875400799114368:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 15193us (15515us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1788521829.986251:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 56 00000020:00080000:3.0:1788521829.986256:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788521829.998652:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521829.998728:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799114624 00000100:00100000:2.0:1788521829.998739:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799114624 00000100:00100000:2.0:1788521829.998797:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 203 00000100:00100000:2.0:1788521829.998807:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+50:11574:x1875400799114624:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521829.998830:0:10083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521829.998854:0:10083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927ca40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00c9c expref: -99 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.998924:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927ca40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c9c expref: 51 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.998940:0:10083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927ca40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c9c expref: 51 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521829.998957:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:2.0:1788521829.998960:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788521829.998964:0:10083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490ac00, rc 0) 00000100:00100000:2.0:1788521829.999035:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+51:11574:x1875400799114624:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 229us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521829.999042:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 203 00000100:00100000:2.0:1788521830.004385:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521830.004496:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799114880 00000100:00100000:3.0:1788521830.004506:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799114880 00000100:00100000:3.0:1788521830.004568:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 57 00000100:00100000:3.0:1788521830.004577:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb791ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+51:11574:x1875400799114880:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:3.0:1788521830.004826:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb791ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+52:11574:x1875400799114880:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 250us (449us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1788521830.004834:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 57 00000100:00100000:3.0:1788521830.131288:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521830.131452:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799115008 00000100:00100000:1.0:1788521830.131463:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799115008 00000100:00100000:1.0:1788521830.131558:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 204 00000100:00100000:1.0:1788521830.131569:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+52:11584:x1875400799115008:12345-192.168.206.48@tcp:34:lfs.0 00010000:00010000:1.0:1788521830.131644:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927ca47 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.131661:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927ca47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.131673:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927ca47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.131689:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927ca4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.131696:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927ca4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.131704:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927ca4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.131797:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927ca55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.131806:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927ca55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.131812:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927ca55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788521830.131850:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927ca55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.131860:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927ca47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.131866:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927ca47 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.131884:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927ca47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.131890:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521830.131894:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927ca47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.131900:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927ca47 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.131910:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:1.0:1788521830.131913:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521830.131917:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927ca47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.131929:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927ca47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.131945:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927ca4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.131952:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927ca4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.131958:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927ca4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.131962:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521830.131965:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927ca4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.131971:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927ca4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.131978:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff996fa0d5c100) 00010000:00010000:1.0:1788521830.131980:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521830.131983:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927ca4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.131988:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5e00/0x1b7b50db5927ca4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.132001:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927ca55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.132007:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927ca55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.132017:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927ca55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.132021:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d4e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521830.132024:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927ca55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.132030:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927ca55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.132038:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:1.0:1788521830.132041:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521830.132043:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927ca55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.132048:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4e00/0x1b7b50db5927ca55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521830.132119:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+52:11584:x1875400799115008:12345-192.168.206.48@tcp:34:lfs.0 Request processed in 552us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521830.132127:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 204 00000100:00100000:1.0:1788521830.194856:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521830.194961:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799115264 00000100:00100000:2.0:1788521830.194971:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799115264 00000100:00100000:2.0:1788521830.195030:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 205 00000100:00100000:2.0:1788521830.195040:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+52:11587:x1875400799115264:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521830.195058:0:10083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521830.195078:0:10083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927ca5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00ca3 expref: -99 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.195178:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927ca63 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.195193:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927ca63 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.195204:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927ca63 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.195222:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927ca6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.195229:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927ca6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.195235:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927ca6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.195347:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927ca71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.195369:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927ca71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.195376:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927ca71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521830.195387:0:10083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788521830.195527:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927ca63 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.195535:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927ca63 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.195541:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927ca63 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.195546:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490b000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521830.195551:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927ca63 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.195558:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927ca63 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.195570:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:2.0:1788521830.195573:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521830.195578:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927ca63 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.195584:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927ca63 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.195596:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927ca6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.195610:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927ca6a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.195616:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927ca6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.195621:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490bc00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521830.195624:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927ca6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.195630:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927ca6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.195638:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff996fb19ef600) 00010000:00010000:2.0:1788521830.195640:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521830.195643:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927ca6a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.195648:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927ca6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.195688:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927ca5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ca3 expref: 55 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.195701:0:10083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927ca71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ca3 expref: 54 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.195707:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:2.0:1788521830.195710:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521830.195718:0:10083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490aa00, rc 0) 00000100:00100000:2.0:1788521830.195781:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+54:11587:x1875400799115264:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 742us (934us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1788521830.195789:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 205 00000100:00100000:2.0:1788521830.199943:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521830.200307:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799115392 00000100:00100000:0.0:1788521830.200318:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799115392 00000100:00100000:0.0:1788521830.200386:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 206 00000100:00100000:0.0:1788521830.200396:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb791d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+54:11587:x1875400799115392:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:0.0:1788521830.200483:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927ca7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.200500:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927ca7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.200526:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927ca7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.200555:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927ca7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.200562:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927ca7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.200569:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927ca7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.200574:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521830.200579:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927ca7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.200586:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927ca7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.200599:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:0.0:1788521830.200602:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788521830.200608:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927ca7f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.200614:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927ca7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521830.200701:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb791d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+54:11587:x1875400799115392:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 306us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521830.200709:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 206 00000100:00100000:3.0:1788521830.203895:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521830.204016:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799115648 00000100:00100000:0.0:1788521830.204041:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799115648 00000100:00100000:0.0:1788521830.204094:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 58 00000100:00100000:0.0:1788521830.204105:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+54:11587:x1875400799115648:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:0.0:1788521830.204394:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+55:11587:x1875400799115648:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 289us (508us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788521830.204401:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 58 00000100:00100000:2.0:1788521830.222392:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbcb31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816928000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521830.222496:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521830.222694:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816928000 00000100:00100000:0.0:1788521830.222702:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816928000 00000100:00100000:0.0:1788521830.222764:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788521830.222774:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb791c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3307:x1875400816928000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788521830.222795:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54460416 pending 3407872 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521830.222853:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb791c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3307:x1875400816928000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521830.222861:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788521830.223018:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521830.223693:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbcb31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816928000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521830.313665:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521830.313811:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799115904 00000100:00100000:0.0:1788521830.313821:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799115904 00000100:00100000:0.0:1788521830.313880:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 207 00000100:00100000:0.0:1788521830.313891:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb791f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+55:11597:x1875400799115904:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:0.0:1788521830.314108:0:10083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521830.314112:0:10083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788521830.314139:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927ca01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c87 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.314185:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:0.0:1788521830.314190:0:10083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788521830.314203:0:10083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927ca86 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00caa expref: -99 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.314314:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927ca8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.314328:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927ca8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.314338:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927ca8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521830.314349:0:10083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788521830.314558:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927ca86 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00caa expref: 57 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.314572:0:10083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927ca8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00caa expref: 56 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.314579:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:0.0:1788521830.314581:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788521830.314584:0:10083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4001800, rc 0) 00000100:00100000:0.0:1788521830.314681:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb791f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+56:11597:x1875400799115904:12345-192.168.206.48@tcp:101:bash.0 Request processed in 792us (1024us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788521830.314689:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 207 00000100:00100000:1.0:1788521830.321795:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521830.321878:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799116160 00000100:00100000:0.0:1788521830.321888:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799116160 00000100:00100000:0.0:1788521830.321957:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 208 00000100:00100000:0.0:1788521830.321968:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+56:11597:x1875400799116160:12345-192.168.206.48@tcp:36:bash.0 00010000:00010000:0.0:1788521830.322022:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788521830.322059:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927ca8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00caa expref: 56 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.322081:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927ca71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ca3 expref: 55 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.322091:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:0.0:1788521830.322097:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788521830.322340:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927ca9b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.322354:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927ca9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.322364:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927ca9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788521830.322427:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1788521830.322464:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000107ef3ed reply state 0000000040fdab93 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927ca9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521830.322474:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788521830.322553:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+57:11597:x1875400799116160:12345-192.168.206.48@tcp:36:bash.0 Request processed in 587us (764us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1788521830.322561:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 208 00000020:00080000:0.0:1788521830.322565:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788521830.326331:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927ca9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.326345:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927ca9b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.326371:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927ca9b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.326376:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521830.326381:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927ca9b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.326389:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927ca9b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.326403:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:0.0:1788521830.326406:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521830.326423:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927ca9b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.326430:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927ca9b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521830.329234:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521830.329325:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799116288 00000100:00100000:2.0:1788521830.329334:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799116288 00000100:00100000:2.0:1788521830.329384:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 209 00000100:00100000:2.0:1788521830.329394:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+56:11597:x1875400799116288:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:2.0:1788521830.329429:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521830.329448:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927caa2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00cb1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.329523:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927caa9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.329536:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927caa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.329546:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927caa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521830.329570:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788521830.329574:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521830.329604:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927caa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.329628:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927caa2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cb1 expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.329645:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927caa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cb1 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.329653:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:2.0:1788521830.329655:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521830.329659:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490b000, rc 0) 00000100:00100000:2.0:1788521830.329720:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+57:11597:x1875400799116288:12345-192.168.206.48@tcp:101:bash.0 Request processed in 326us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521830.329727:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 209 00000100:00100000:3.0:1788521830.339788:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521830.340024:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799116544 00000100:00100000:0.0:1788521830.340034:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799116544 00000100:00100000:0.0:1788521830.340092:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 59 00000100:00100000:0.0:1788521830.340102:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+57:11597:x1875400799116544:12345-192.168.206.48@tcp:35:bash.0 00000100:00100000:0.0:1788521830.340643:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+58:11597:x1875400799116544:12345-192.168.206.48@tcp:35:bash.0 Request processed in 540us (936us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788521830.340651:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 59 00000100:00100000:1.0:1788521830.440319:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521830.441541:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799116672 00000100:00100000:0.0:1788521830.441553:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799116672 00000100:00100000:0.0:1788521830.441655:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 210 00000100:00100000:0.0:1788521830.441666:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+58:11603:x1875400799116672:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1788521830.441715:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521830.441736:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927cab0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00cb8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.441799:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927cab7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.441813:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927cab7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.441825:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927cab7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521830.441858:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788521830.441862:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788521830.441880:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927cab7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.441903:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927cab0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cb8 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.441921:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927cab7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cb8 expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.441929:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:0.0:1788521830.441932:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788521830.441936:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4001800, rc 0) 00000100:00100000:0.0:1788521830.442000:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+59:11603:x1875400799116672:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 336us (1689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521830.442007:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 210 00000100:00100000:2.0:1788521830.446319:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521830.464442:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799116800 00000100:00100000:1.0:1788521830.464459:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799116800 00000100:00100000:1.0:1788521830.464646:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 211 00000100:00100000:1.0:1788521830.464659:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb791f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+59:11603:x1875400799116800:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1788521830.464695:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521830.464717:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927cabe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00cbf expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.464781:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927cac5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.464796:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927cac5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.464807:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927cac5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.464822:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927cacc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.464828:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927cacc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.464833:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927cacc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.464953:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927cad3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.464963:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927cad3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.464969:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927cad3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521830.465004:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788521830.465014:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521830.465036:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927cad3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.465047:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927cad3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.465055:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927cac5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.465062:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927cac5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.465069:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927cac5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.465075:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521830.465079:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927cac5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.465087:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927cac5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.465098:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:1.0:1788521830.465101:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521830.465107:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927cac5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.465114:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927cac5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.465130:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927cacc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.465167:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927cacc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.465173:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927cacc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.465178:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d4400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521830.465181:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927cacc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.465187:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927cacc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.465389:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff996fa0d5c100) 00010000:00010000:1.0:1788521830.465393:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521830.465397:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927cacc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.465403:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927cacc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.465447:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5600/0x1b7b50db5927cabe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cbf expref: 61 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.465462:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927cad3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cbf expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.465470:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:1.0:1788521830.465472:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521830.465481:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d5a00, rc 0) 00000100:00100000:1.0:1788521830.465548:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb791f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+60:11603:x1875400799116800:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 891us (19260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521830.465554:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 211 00000100:00100000:3.0:1788521830.476781:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521830.476882:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799117056 00000100:00100000:2.0:1788521830.476890:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799117056 00000100:00100000:2.0:1788521830.476960:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 212 00000100:00100000:2.0:1788521830.476970:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb3f5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+60:11603:x1875400799117056:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521830.476990:0:10083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521830.477011:0:10083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927cada lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00cc6 expref: -99 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.477103:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927cae1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.477118:0:10083:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927caa9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cb1 expref: 61 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.477173:0:10083:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927cad3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cbf expref: 61 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.477182:0:10083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927cae1 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.477477:0:10083:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927cad3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cbf expref: 61 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.477497:0:10083:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927cad3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cbf expref: 61 pid: 5835 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521830.477512:0:10083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb791d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10083:1875400816928128:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788521830.477618:0:10083:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927caa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cb1 expref: 61 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.477629:0:10083:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927caa9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cb1 expref: 61 pid: 5833 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521830.477638:0:10083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb791ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10083:1875400816928256:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788521830.477663:0:10083:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90f5a180 going to sleep for 11 seconds 00000100:00100000:2.0:1788521830.480749:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521830.480818:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799117184 00000100:00100000:0.0:1788521830.480830:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799117184 00010000:00010000:0.0:1788521830.480880:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927cad3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cbf expref: 62 pid: 5835 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521830.480938:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 79 00000100:00100000:0.0:1788521830.480948:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb791e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+62:2362:x1875400799117184:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521830.480963:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521830.480970:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927cad3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cbf expref: 62 pid: 5835 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.480991:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927cad3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cbf expref: 62 pid: 5835 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.481013:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:0.0:1788521830.481018:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927cae1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.481027:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927cae1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.481033:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521830.481093:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb791e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+62:2362:x1875400799117184:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 146us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521830.481113:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 79 00010000:00010000:2.0:1788521830.483215:0:10083:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.48@tcp) returned -22 from blocking AST (req@00000000dd8b528c x1875400816928128) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927cad3 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cbf expref: 61 pid: 5835 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.483258:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5a00/0x1b7b50db5927cad3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cbf expref: 61 pid: 5835 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521830.483289:0:10083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb791d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10083:1875400816928128:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788521830.483307:0:10083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb791ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10083:1875400816928256:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788521830.483330:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:2.0:1788521830.483336:0:10083:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927cae1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.483344:0:10083:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927cae1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521830.483352:0:10083:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927cae1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521830.483704:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521830.488391:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799117312 00000100:00100000:0.0:1788521830.488405:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799117312 00010000:00010000:0.0:1788521830.488471:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927caa9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cb1 expref: 61 pid: 5833 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521830.488528:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 80 00000100:00100000:0.0:1788521830.488538:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb791ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+61:2364:x1875400799117312:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521830.488553:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521830.488561:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927caa9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cb1 expref: 61 pid: 5833 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.488581:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927caa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cb1 expref: 61 pid: 5833 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.488603:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927caa9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cb1 expref: 61 pid: 5833 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.488620:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:0.0:1788521830.488625:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927cae1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.488635:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927cae1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.488642:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927cae1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.488679:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788521830.488714:0:10083:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927cae1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.488722:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927cae1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521830.488732:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb791ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+60:2364:x1875400799117312:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 196us (5029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521830.488738:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 80 00000004:00200000:1.0:1788521830.488739:0:10083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788521830.488873:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490bc00/0x1b7b50db5927cada lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cc6 expref: 61 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.488888:0:10083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927cae1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cc6 expref: 60 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.488895:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:1.0:1788521830.488910:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788521830.488913:0:10083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490aa00, rc 0) 00000100:00100000:1.0:1788521830.488950:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb3f5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+60:11603:x1875400799117056:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 11982us (12177us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788521830.488957:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 212 00000100:00100000:2.0:1788521830.498435:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521830.498634:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799117568 00000100:00100000:0.0:1788521830.498660:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799117568 00000100:00100000:0.0:1788521830.498762:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:0.0:1788521830.498774:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f856e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+60:11603:x1875400799117568:12345-192.168.206.48@tcp:103:lfs.0 00010000:00010000:0.0:1788521830.498790:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521830.498814:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927ca40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c9c expref: 60 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.498832:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:0.0:1788521830.498837:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521830.498943:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f856e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+59:11603:x1875400799117568:12345-192.168.206.48@tcp:103:lfs.0 Request processed in 162us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521830.498951:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:0.0:1788521830.502947:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521830.503082:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799117696 00000100:00100000:3.0:1788521830.503092:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799117696 00000100:00100000:3.0:1788521830.503174:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 213 00000100:00100000:3.0:1788521830.503185:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbcb31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+59:11603:x1875400799117696:12345-192.168.206.48@tcp:58:lfs.0 00010000:00010000:3.0:1788521830.503286:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927caef lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.503305:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927caef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.503318:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927caef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788521830.503542:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1788521830.503635:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbcb31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+59:11603:x1875400799117696:12345-192.168.206.48@tcp:58:lfs.0 Request processed in 452us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521830.503643:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 213 00000100:00100000:1.0:1788521830.508676:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521830.508770:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799117824 00000100:00100000:0.0:1788521830.508780:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799117824 00000100:00100000:0.0:1788521830.508893:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 214 00000100:00100000:0.0:1788521830.508906:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+59:11603:x1875400799117824:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1788521830.508928:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521830.508951:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927caf6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00ccd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.509012:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927caef lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.509023:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927caf6 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ccd expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.509043:0:5834:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927caef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.509072:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927caf6 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ccd expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.509086:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:0.0:1788521830.509089:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788521830.509093:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927caf6 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ccd expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.509100:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4000400, rc 0) 00000100:00100000:0.0:1788521830.509270:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+60:11603:x1875400799117824:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 297us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521830.509277:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 214 00010000:00010000:1.0:1788521830.544482:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788521830.734419:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788521830.734428:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788521830.734741:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1788521830.734749:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788521830.736250:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc426a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1875400816928384:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788521830.736426:0:11682:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fad8049c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521830.748023:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc426a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1875400816928384:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788521830.750075:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521830.750762:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799117952 00000100:00100000:0.0:1788521830.750773:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799117952 00000100:00100000:0.0:1788521830.750838:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 215 00000100:00100000:0.0:1788521830.750848:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb791d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+60:11604:x1875400799117952:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788521830.750933:0:5833:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788521830.751029:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb791d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+60:11604:x1875400799117952:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 182us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521830.751037:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 215 00000100:00100000:2.0:1788521830.757000:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521830.757070:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799118080 00000100:00100000:0.0:1788521830.757079:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799118080 00000100:00100000:0.0:1788521830.757130:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 216 00000100:00100000:0.0:1788521830.757160:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb791c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+60:11604:x1875400799118080:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788521830.757230:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cafd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.757259:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cafd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.757270:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cafd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.757333:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927cb04 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.757342:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927cb04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.757348:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927cb04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.757369:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927cb0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.757377:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927cb0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.757384:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927cb0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521830.757432:0:10083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788521830.757436:0:10083:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788521830.757449:0:10083:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927cb0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.757460:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cafd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.757477:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cafd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.757484:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cafd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.757491:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4001000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521830.757495:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cafd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.757503:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cafd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.757531:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996fb19efc00) 00010000:00010000:0.0:1788521830.757535:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521830.757540:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cafd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.757546:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cafd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.757558:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927cb04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.757564:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927cb04 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.757570:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927cb04 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.757575:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521830.757584:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927cb04 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.757591:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927cb04 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.757599:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff996f83d6da00) 00010000:00010000:0.0:1788521830.757602:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521830.757605:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927cb04 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.757611:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927cb04 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.760433:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927cb0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.760450:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927cb0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.760458:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927cb0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.760464:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521830.760469:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927cb0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.760477:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927cb0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.760493:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:0.0:1788521830.760496:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521830.760520:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927cb0b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.760528:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927cb0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521830.761208:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb791c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+60:11604:x1875400799118080:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 Request processed in 4061us (4208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521830.761220:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 216 00000100:00100000:1.0:1788521830.772455:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521830.772748:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799118336 00000100:00100000:3.0:1788521830.772769:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799118336 00000100:00100000:3.0:1788521830.772827:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 217 00000100:00100000:3.0:1788521830.772837:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+60:11604:x1875400799118336:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521830.772856:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521830.773019:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927cb12 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00cd4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.773112:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927cb19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.773126:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927cb19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.773137:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927cb19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521830.773192:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788521830.773287:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927cb19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.773295:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927cb19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.773301:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927cb19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.773306:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392d400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521830.773310:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927cb19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.773317:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927cb19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.773336:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:3.0:1788521830.773339:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788521830.773344:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927cb19 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.773350:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927cb19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.773386:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927cb12 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cd4 expref: 62 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.773395:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996fb19efc00) 00010000:00010000:3.0:1788521830.773397:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788521830.773401:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927cb12 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cd4 expref: 62 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.773421:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392de00, rc 0) 00000100:00100000:3.0:1788521830.773710:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+61:11604:x1875400799118336:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 873us (1271us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1788521830.773719:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 217 00000100:00100000:2.0:1788521830.786785:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521830.786981:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799118464 00000100:00100000:3.0:1788521830.786992:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799118464 00000100:00100000:3.0:1788521830.787054:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 218 00000100:00100000:3.0:1788521830.787067:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb791df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+61:11604:x1875400799118464:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788521830.787125:0:5834:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788521830.787263:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb791df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+61:11604:x1875400799118464:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 198us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521830.787282:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 218 00000100:00100000:2.0:1788521830.792193:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521830.792311:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799118720 00000100:00100000:3.0:1788521830.792323:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799118720 00000100:00100000:3.0:1788521830.792384:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 219 00000100:00100000:3.0:1788521830.792395:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb791c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+61:11604:x1875400799118720:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521830.792426:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521830.792429:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788521830.792464:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927cab7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cb8 expref: 61 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.792486:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:3.0:1788521830.792490:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788521830.792504:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927cb27 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00cdb expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788521830.793300:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:3.0:1788521830.794255:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927cb2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.794276:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927cb2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.794289:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927cb2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.794366:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927cb27 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cdb expref: 63 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.794404:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927cb2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cdb expref: 62 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.794426:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff996f8687e500) 00010000:00010000:3.0:1788521830.794429:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521830.794433:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392d400, rc 0) 00000100:00100000:3.0:1788521830.794989:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb791c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+62:11604:x1875400799118720:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 2592us (2803us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1788521830.794998:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 219 00000001:00080000:0.0:1788521830.795240:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:0.0:1788521830.795257:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:0.0:1788521830.795266:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:2.0:1788521830.799124:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521830.802101:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799118976 00000100:00100000:3.0:1788521830.802117:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799118976 00000100:00100000:3.0:1788521830.802250:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 220 00000100:00100000:3.0:1788521830.802262:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb791f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+62:11604:x1875400799118976:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788521830.802324:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521830.802350:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927cb2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cdb expref: 62 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.802369:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff996f8687e500) 00010000:00010000:3.0:1788521830.802381:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788521830.802401:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927cb3c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.802427:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927cb3c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.802447:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927cb3c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.802534:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927cb43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xf7be8dc9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.802544:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927cb43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf7be8dc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.802551:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927cb43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf7be8dc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.802611:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927cb3c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.802619:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927cb3c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.802626:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927cb3c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.802632:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392de00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521830.802637:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927cb3c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.802644:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927cb3c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.802652:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:3.0:1788521830.802655:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521830.802659:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927cb3c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.802664:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927cb3c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.802680:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927cb43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf7be8dc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.802686:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927cb43 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf7be8dc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.802692:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927cb43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf7be8dc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.802697:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392c800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521830.802700:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927cb43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf7be8dc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.802705:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927cb43 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf7be8dc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.802712:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xf7be8dc9 (ffff996f8687ee00) 00010000:00010000:3.0:1788521830.802715:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521830.802718:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927cb43 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf7be8dc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.802723:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927cb43 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf7be8dc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521830.802815:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb791f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+61:11604:x1875400799118976:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 555us (3699us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788521830.802823:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 220 00000100:00100000:2.0:1788521830.816060:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521830.816206:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799119104 00000100:00100000:3.0:1788521830.816216:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799119104 00000100:00100000:3.0:1788521830.816277:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 221 00000100:00100000:3.0:1788521830.816305:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb791d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+61:11604:x1875400799119104:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521830.816326:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521830.816348:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927cb4a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00ce2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.816381:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927cb51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.816396:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927cb51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.816421:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927cb51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.816531:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927cb4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ce2 expref: 63 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.816550:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927cb51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ce2 expref: 62 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.816559:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff996f8687ee00) 00010000:00010000:3.0:1788521830.816562:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788521830.816565:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392de00, rc 0) 00000100:00100000:3.0:1788521830.816627:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb791d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+62:11604:x1875400799119104:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 326us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521830.816635:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 221 00000100:00100000:2.0:1788521830.829241:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521830.829330:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799119360 00000100:00100000:1.0:1788521830.829340:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799119360 00000100:00100000:1.0:1788521830.829390:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 222 00000100:00100000:1.0:1788521830.829399:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb791ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+62:11604:x1875400799119360:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788521830.829502:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927cb58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.829518:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927cb58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.829530:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927cb58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788521830.829754:0:10083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1788521830.829762:0:10083:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 330814619341ns, next at 331814617498ns, rc = 0 00000004:00010000:1.0:1788521830.829836:0:10083:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ba74918 reply state 00000000163f8bf2 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927cb58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521830.829845:0:10083:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788521830.829948:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb791ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+64:11604:x1875400799119360:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 541us (708us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1788521830.829956:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 222 00010000:00010000:0.0:1788521830.834742:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927cb58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.834761:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927cb58 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.834769:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927cb58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.834774:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521830.834780:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927cb58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.834787:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927cb58 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.834803:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff996f8687ee00) 00010000:00010000:0.0:1788521830.834806:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788521830.834812:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927cb58 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.834818:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927cb58 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521830.840459:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521830.840608:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799119488 00000100:00100000:3.0:1788521830.840618:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799119488 00000100:00100000:3.0:1788521830.840675:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 223 00000100:00100000:3.0:1788521830.840701:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb791e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+63:11604:x1875400799119488:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521830.840724:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521830.840743:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927cb5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00ce9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.840799:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927cb5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ce9 expref: 64 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.840815:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927cb5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ce9 expref: 64 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.840832:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff996f8687ee00) 00010000:00010000:3.0:1788521830.840835:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788521830.840839:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392c800, rc 0) 00000100:00100000:3.0:1788521830.840899:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb791e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+64:11604:x1875400799119488:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 201us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521830.840906:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 223 00000100:00100000:1.0:1788521830.846273:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521830.846383:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799119616 00000100:00100000:3.0:1788521830.846394:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799119616 00000100:00080000:0.0:1788521830.846519:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521830.846538:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 62 00000100:00100000:3.0:1788521830.846550:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+9:2363:x1875400799119616:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788521830.846876:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+10:2363:x1875400799119616:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 327us (612us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1788521830.846884:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 62 00000100:00100000:1.0:1788521830.854935:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521830.855116:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799119872 00000100:00100000:2.0:1788521830.855160:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799119872 00000100:00100000:2.0:1788521830.855264:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 60 00000100:00100000:2.0:1788521830.855275:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+64:11604:x1875400799119872:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788521830.855749:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+65:11604:x1875400799119872:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 474us (892us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788521830.855759:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 60 00000100:00100000:1.0:1788521830.860306:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521830.860406:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799120128 00000100:00100000:2.0:1788521830.860426:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799120128 00000100:00100000:2.0:1788521830.860498:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 224 00000100:00100000:2.0:1788521830.860509:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+65:11604:x1875400799120128:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788521830.860618:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+65:11604:x1875400799120128:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 111us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521830.860626:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 224 00000100:00100000:1.0:1788521830.871260:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521830.871396:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799120256 00000100:00100000:3.0:1788521830.871405:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799120256 00000100:00100000:3.0:1788521830.871583:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 225 00000100:00100000:3.0:1788521830.871593:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+65:11604:x1875400799120256:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521830.871613:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521830.871635:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927cb66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00cf0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.871698:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927cb6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.871712:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927cb6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.871725:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927cb6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521830.871761:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788521830.871782:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927cb6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.871805:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392d400/0x1b7b50db5927cb66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cf0 expref: 67 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.871823:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927cb6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cf0 expref: 66 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.871832:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff996f8687ee00) 00010000:00010000:3.0:1788521830.871835:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788521830.871838:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392c400, rc 0) 00000100:00100000:2.0:1788521830.872759:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+66:11604:x1875400799120256:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 1162us (1500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521830.872770:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 225 00000100:00100000:1.0:1788521830.881787:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521830.881894:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799120384 00000100:00100000:3.0:1788521830.881904:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799120384 00000100:00100000:3.0:1788521830.881979:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 63 00000100:00100000:3.0:1788521830.881989:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+10:2364:x1875400799120384:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521830.882006:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521830.882026:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927cb74 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00cf7 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788521830.882051:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9aad67, blocks: 0x1 00010000:00010000:3.0:1788521830.882070:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=330s v=(0 0) 00010000:00010000:3.0:1788521830.882075:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521830.882085:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927cb74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cf7 expref: 11 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.882102:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927cb74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cf7 expref: 11 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.882115:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f80031a00, rc 0) 00000100:00100000:3.0:1788521830.882197:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+11:2364:x1875400799120384:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 209us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521830.882204:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 63 00000100:00100000:3.0:1788521830.885846:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521830.886069:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799120640 00000100:00100000:2.0:1788521830.886079:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799120640 00000100:00100000:2.0:1788521830.886175:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 226 00000100:00100000:2.0:1788521830.886187:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+66:11604:x1875400799120640:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788521830.886296:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+66:11604:x1875400799120640:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 111us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521830.886303:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 226 00000100:00100000:1.0:1788521830.890787:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521830.890881:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799120768 00000100:00100000:3.0:1788521830.890889:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799120768 00000100:00100000:3.0:1788521830.890994:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 64 00000100:00100000:3.0:1788521830.891005:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+11:11604:x1875400799120768:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521830.891022:0:11097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521830.891043:0:11097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0b98684/0x1b7b50db5927cb7b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00cfe expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.891091:0:11097:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927cb74 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cf7 expref: 12 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.891101:0:11097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521830.891105:0:11097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521830.891111:0:11097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0b98684/0x1b7b50db5927cb7b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cfe expref: 12 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.891192:0:11097:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927cb74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cf7 expref: 12 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.891214:0:11097:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927cb74 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cf7 expref: 12 pid: 6690 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521830.891229:0:11097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7895880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11097:1875400816928512:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788521830.891334:0:11097:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f98823540 going to sleep for 11 seconds 00000100:00100000:3.0:1788521830.894585:0:11097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7895880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11097:1875400816928512:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788521830.894623:0:11097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0b98684/0x1b7b50db5927cb7b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cfe expref: 12 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.894645:0:11097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f80030400, rc 0) 00000100:00100000:3.0:1788521830.894705:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+12:11604:x1875400799120768:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 3702us (3926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521830.894714:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 64 00000100:00100000:1.0:1788521830.897871:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521830.898235:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799120896 00000100:00100000:3.0:1788521830.898245:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799120896 00010000:00010000:3.0:1788521830.898288:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927cb74 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cf7 expref: 12 pid: 6690 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521830.898332:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 81 00000100:00100000:3.0:1788521830.898343:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+12:2363:x1875400799120896:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521830.898358:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521830.898381:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927cb74 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cf7 expref: 12 pid: 6690 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.898402:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927cb74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cf7 expref: 12 pid: 6690 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.898565:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927cb74 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cf7 expref: 12 pid: 6690 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.898586:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521830.898590:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521830.898599:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0b98684/0x1b7b50db5927cb7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cfe expref: 11 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.898610:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0b98684/0x1b7b50db5927cb7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cfe expref: 11 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.898652:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f0b98684/0x1b7b50db5927cb7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cfe expref: 11 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521830.898677:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7895880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5818:1875400816928640:192.168.206.48@tcp:105: 00000100:00100000:3.0:1788521830.898762:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f98823540 going to sleep for 11 seconds 00000100:00100000:3.0:1788521830.903469:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7895880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5818:1875400816928640:192.168.206.48@tcp:105: 00010000:00010000:3.0:1788521830.903497:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521830.903558:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+11:2363:x1875400799120896:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 5216us (5714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521830.903571:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 81 00000100:00100000:1.0:1788521830.905648:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521830.905739:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799121024 00000100:00100000:2.0:1788521830.905749:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799121024 00002000:00100000:2.0:1788521830.905810:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff996f85d37b80 x1875400799121024/t0(0) o4->4bd13e8f-aac9-42ad-8625-a542705d6920@192.168.206.48@tcp:76/0 lens 504/0 e 0 to 0 dl 1788521841 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788521830.905820:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff996f85d37b80 with x1875400799121024 ext(0->12) 00002000:00010000:2.0:1788521830.905826:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996f85d37b80 00000100:00100000:2.0:1788521830.905871:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:2.0:1788521830.905881:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+11:2363:x1875400799121024:12345-192.168.206.48@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788521830.906353:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+13:2363:x1875400799121024:12345-192.168.206.48@tcp:4:lhsmtool_posix.0 Request processed in 472us (712us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788521830.906361:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 6 00002000:00100000:2.0:1788521830.906368:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff996f85d37b80 x1875400799121024/t4294967320(0) o4->4bd13e8f-aac9-42ad-8625-a542705d6920@192.168.206.48@tcp:76/0 lens 504/448 e 0 to 0 dl 1788521841 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788521830.906377:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff996f85d37b80 with x1875400799121024 ext(0->12) 00002000:00010000:2.0:1788521830.906380:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996f85d37b80 00000100:00100000:1.0:1788521830.912496:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521830.912880:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799121152 00000100:00100000:2.0:1788521830.912891:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799121152 00000100:00100000:2.0:1788521830.912964:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 227 00000100:00100000:2.0:1788521830.912976:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+66:11604:x1875400799121152:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788521830.946354:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+66:11604:x1875400799121152:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 Request processed in 33369us (33857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521830.946369:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 227 00000001:00080000:3.0:1788521830.946418:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967501 is committed 00000020:00080000:3.0:1788521830.946463:0:5856:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:3.0:1788521830.946480:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:3.0:1788521830.946484:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000001:00080000:3.0:1788521830.946509:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1788521830.946529:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1788521830.946536:0:5856:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff996f82df43c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788521830.946540:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff996fa0361b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff996f82df4900 00000020:00080000:3.0:1788521830.946543:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff996fa0361c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff996fb484d000 00000004:00080000:3.0:1788521830.946557:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788521830.946571:0:5856:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff996fb18d7300 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788521830.946574:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff996f85730500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff996fbc3c4480 00000020:00080000:3.0:1788521830.946577:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff996f85730900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff996fbc438400 00000020:00080000:3.0:1788521830.946617:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1788521830.946804:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788521830.947350:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816929024:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788521830.947399:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521830.947458:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816929024 00000100:00100000:3.0:1788521830.947464:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816929024 00000100:00100000:3.0:1788521830.947505:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788521830.947513:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7895c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816929024:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788521830.947536:0:6687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1788521830.947567:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9aad66, atime: 0x6a9aad66, ctime: 0x6a9aad66, blocks: 0xb 00010000:00010000:3.0:1788521830.947575:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004383965f/0x1b7b50db5927cb82 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.947591:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=330s v=(0 0) 00010000:00010000:3.0:1788521830.947595:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521830.947601:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004383965f/0x1b7b50db5927cb82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.947616:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004383965f/0x1b7b50db5927cb82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.947625:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004383965f/0x1b7b50db5927cb82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.947633:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004383965f/0x1b7b50db5927cb82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.947663:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788521830.948475:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816928768:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788521830.948525:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521830.948560:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788521830.948567:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816928896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788521830.948592:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521830.948624:0:12322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816928768 00000100:00100000:0.0:1788521830.948630:0:12322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816928768 00000100:00100000:0.0:1788521830.948669:0:12322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816928896 00000100:00100000:0.0:1788521830.948673:0:12322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816928896 00000100:00100000:0.0:1788521830.948686:0:12322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788521830.948692:0:12322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3304:x1875400816928768:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788521830.948711:0:12322:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:0.0:1788521830.948728:0:12322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000820feff9/0x1b7b50db5927cb89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.948744:0:12322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000025c4db71/0x1b7b50db5927c944 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c5d expref: 12 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.948751:0:12322:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788521830.948755:0:12322:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788521830.948759:0:12322:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000820feff9/0x1b7b50db5927cb89 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.948788:0:12322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000025c4db71/0x1b7b50db5927c944 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c5d expref: 12 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521830.948826:0:12322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000025c4db71/0x1b7b50db5927c944 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c5d expref: 12 pid: 6689 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521830.948838:0:12322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fadfcd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12322:1875400816929152:192.168.206.48@tcp:104: 00000100:00100000:0.0:1788521830.948910:0:12322:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cb900 going to sleep for 11 seconds 00000100:00100000:0.0:1788521830.948927:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788521830.948935:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc7d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3304:x1875400816928896:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788521830.949723:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788521830.949729:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788521831 00002000:00010000:0.0:1788521830.949731:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788521830.949734:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788521831 -> 1788521831 00002000:00010000:0.0:1788521830.949736:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788521830.949789:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc7d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3304:x1875400816928896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 854us (1194us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788521830.949798:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1788521830.949828:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788521830.949874:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff996fb7897b80/2, rc 0, transno 4294967321 00000100:00100000:0.0:1788521830.949881:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816928896:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788521830.952135:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7895c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875400816929024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4616us (4729us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788521830.952171:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:3.0:1788521830.952210:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521830.952218:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004383965f/0x1b7b50db5927cb82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.952229:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80031a00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521830.952234:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004383965f/0x1b7b50db5927cb82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.952245:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004383965f/0x1b7b50db5927cb82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.952264:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004383965f/0x1b7b50db5927cb82 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.952271:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004383965f/0x1b7b50db5927cb82 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.952292:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521830.952294:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521830.952295:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521830.952405:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521830.953089:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1788521830.953096:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967309 00000004:00080000:2.0:1788521830.953114:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff996fb7a7f480, transno 4294967307 00000004:00080000:2.0:1788521830.953132:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:2.0:1788521830.953170:0:3306:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff996fb7896300 x1875400816929024/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788521846 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788521830.953186:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff996fb7896300/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788521830.953192:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816929024:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788521830.953823:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799121280 00000100:00100000:3.0:1788521830.953831:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799121280 00000100:00100000:3.0:1788521830.953883:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 68 00000100:00100000:3.0:1788521830.953892:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+13:2361:x1875400799121280:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788521830.959747:0:12322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fadfcd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12322:1875400816929152:192.168.206.48@tcp:104: 00010000:00010000:0.0:1788521830.959782:0:12322:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000820feff9/0x1b7b50db5927cb89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521830.972727:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521830.972810:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799121408 00000100:00100000:3.0:1788521830.972821:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799121408 00010000:00010000:3.0:1788521830.972873:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000025c4db71/0x1b7b50db5927c944 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c5d expref: 14 pid: 6689 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521830.972916:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 82 00000100:00100000:3.0:1788521830.972927:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb791ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+14:2364:x1875400799121408:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521830.972951:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521830.972958:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000025c4db71/0x1b7b50db5927c944 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c5d expref: 14 pid: 6689 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.972982:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000025c4db71/0x1b7b50db5927c944 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c5d expref: 14 pid: 6689 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.973015:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025c4db71/0x1b7b50db5927c944 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c5d expref: 14 pid: 6689 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.973032:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521830.973036:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521830.973042:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000820feff9/0x1b7b50db5927cb89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.973053:0:7633:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000820feff9/0x1b7b50db5927cb89 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.973111:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521830.973191:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb791ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+13:2364:x1875400799121408:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 265us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521830.973200:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 82 00010000:00010000:1.0:1788521830.973403:0:12322:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000820feff9/0x1b7b50db5927cb89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.973425:0:12322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000820feff9/0x1b7b50db5927cb89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.973439:0:12322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000820feff9/0x1b7b50db5927cb89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.973447:0:12322:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000820feff9/0x1b7b50db5927cb89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.973472:0:12322:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521830.974527:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521830.974536:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000820feff9/0x1b7b50db5927cb89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.974546:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000600 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521830.974551:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000820feff9/0x1b7b50db5927cb89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.974560:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000820feff9/0x1b7b50db5927cb89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.974576:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000820feff9/0x1b7b50db5927cb89 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.974584:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000820feff9/0x1b7b50db5927cb89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521830.974604:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521830.974606:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521830.974608:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521830.976932:0:12322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3304:x1875400816928768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 28230us (28396us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788521830.976958:0:12322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:0.0:1788521830.977360:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff996fb7895880/2, rc 0, transno 4294967322 00000100:00100000:0.0:1788521830.977379:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816928768:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1788521830.992492:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:1.0:1788521830.992511:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:0.0:1788521830.993215:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2361:x1875400799121280:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 Request processed in 39317us (40804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521830.993226:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 68 00000100:00100000:2.0:1788521830.999231:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521830.999322:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799121664 00000100:00100000:1.0:1788521830.999331:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799121664 00000100:00100000:1.0:1788521830.999389:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 228 00000100:00100000:1.0:1788521830.999400:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb791fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+20:11604:x1875400799121664:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788521830.999469:0:10083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521830.999496:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c400/0x1b7b50db5927cb6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cf0 expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.999515:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff996f8687ee00) 00010000:00010000:1.0:1788521830.999520:0:10083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788521830.999548:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927cb90 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.999562:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927cb90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521830.999572:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927cb90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788521830.999805:0:10083:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d147baa4 reply state 000000008e04c4cf transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927cb90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521830.999815:0:10083:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788521830.999900:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb791fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+21:11604:x1875400799121664:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 502us (677us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1788521830.999908:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 228 00010000:00010000:0.0:1788521831.002726:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927cb90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.002742:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927cb90 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.002750:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927cb90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.002755:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d4a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521831.002760:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927cb90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.002769:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927cb90 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.002786:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff996f8687ee00) 00010000:00010000:0.0:1788521831.002789:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521831.002794:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927cb90 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.002800:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927cb90 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521831.004859:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521831.004950:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799121792 00000100:00100000:3.0:1788521831.004960:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799121792 00000100:00100000:3.0:1788521831.005049:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 69 00000100:00100000:3.0:1788521831.005060:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb791e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2362:x1875400799121792:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788521831.005296:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788521831.005301:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788521831 -> 1788521830 00002000:00010000:3.0:1788521831.005303:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788521830 00002000:00010000:3.0:1788521831.005305:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788521831 -> 1788521830 00002000:00010000:3.0:1788521831.005308:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788521831.005363:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb791e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+8:2362:x1875400799121792:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 305us (523us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788521831.005371:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 69 00000100:00100000:2.0:1788521831.008828:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521831.009363:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799122048 00000100:00100000:0.0:1788521831.009373:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799122048 00000100:00080000:2.0:1788521831.009527:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521831.009616:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 229 00000100:00100000:0.0:1788521831.009639:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb791ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+20:11604:x1875400799122048:12345-192.168.206.48@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788521831.009700:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cb97 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.009716:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927cb51 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ce2 expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.009725:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cb97 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.009755:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927cb51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ce2 expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.009774:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927cb51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ce2 expref: 20 pid: 5833 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521831.009789:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fadfcd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1875400816929280:192.168.206.48@tcp:104: 00000100:00100000:0.0:1788521831.009927:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cb900 going to sleep for 11 seconds 00000100:00100000:1.0:1788521831.014520:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521831.014799:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799122176 00000100:00100000:2.0:1788521831.014809:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799122176 00010000:00010000:2.0:1788521831.014867:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927cb51 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ce2 expref: 21 pid: 5833 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521831.014905:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 83 00000100:00100000:2.0:1788521831.014915:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+21:2364:x1875400799122176:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521831.014928:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521831.014935:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927cb51 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ce2 expref: 21 pid: 5833 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521831.014968:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927cb51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ce2 expref: 21 pid: 5833 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521831.014989:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff996f8687ee00) 00010000:00010000:2.0:1788521831.014995:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cb97 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521831.015014:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cb97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521831.015022:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cb97 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521831.015055:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521831.015110:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+21:2364:x1875400799122176:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 196us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521831.015118:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 83 00010000:00010000:0.0:1788521831.016136:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927cb51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ce2 expref: 20 pid: 5833 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521831.016184:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fadfcd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1875400816929280:192.168.206.48@tcp:104: 00010000:00010000:0.0:1788521831.016222:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cb97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.016231:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cb97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.016249:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cb97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.016280:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cb97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.016287:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cb97 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.016294:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cb97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.016300:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4001000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521831.016304:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cb97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.016312:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cb97 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.016326:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff996f8687ee00) 00010000:00010000:0.0:1788521831.016328:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788521831.016332:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cb97 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.016339:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cb97 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521831.016399:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb791ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+19:11604:x1875400799122048:12345-192.168.206.48@tcp:55:lhsmtool_posix.0 Request processed in 6763us (7579us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788521831.016419:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 229 00000100:00100000:1.0:1788521831.020649:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521831.020748:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799122304 00000100:00100000:3.0:1788521831.020758:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799122304 00000100:00100000:3.0:1788521831.021228:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 70 00000100:00100000:3.0:1788521831.021245:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+8:2361:x1875400799122304:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788521831.021286:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927cb9e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.021305:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0b98684/0x1b7b50db5927cb7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cfe expref: 8 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.021314:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788521831.021318:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521831.021322:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927cb9e lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.021357:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f0b98684/0x1b7b50db5927cb7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cfe expref: 8 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.021392:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f0b98684/0x1b7b50db5927cb7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cfe expref: 8 pid: 11097 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521831.021419:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7894e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6687:1875400816929408:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788521831.021560:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86759f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788521831.025190:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7894e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6687:1875400816929408:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788521831.025223:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927cb9e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521831.026075:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521831.026694:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799122432 00000100:00100000:3.0:1788521831.026703:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799122432 00010000:00010000:3.0:1788521831.026741:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f0b98684/0x1b7b50db5927cb7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cfe expref: 9 pid: 11097 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521831.026783:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 84 00000100:00100000:3.0:1788521831.026794:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+9:2364:x1875400799122432:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521831.026809:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521831.026831:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f0b98684/0x1b7b50db5927cb7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cfe expref: 9 pid: 11097 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.026864:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f0b98684/0x1b7b50db5927cb7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cfe expref: 9 pid: 11097 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.026887:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0b98684/0x1b7b50db5927cb7b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cfe expref: 9 pid: 11097 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.026912:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521831.026917:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521831.026923:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927cb9e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.026933:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927cb9e lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.027228:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521831.027856:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+8:2364:x1875400799122432:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 1047us (1767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521831.027873:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 84 00010000:00010000:0.0:1788521831.028699:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927cb9e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.028715:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927cb9e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.028747:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927cb9e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.028756:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927cb9e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.028766:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927cb9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.028773:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80031a00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521831.028778:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927cb9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.028788:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927cb9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.028805:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927cb9e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.028813:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004383965f/0x1b7b50db5927cb9e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521831.028926:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2361:x1875400799122304:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 Request processed in 7684us (8284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521831.028935:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 70 00000100:00100000:1.0:1788521831.033031:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521831.033237:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799122688 00000100:00100000:2.0:1788521831.033247:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799122688 00000100:00100000:2.0:1788521831.033303:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 230 00000100:00100000:2.0:1788521831.033314:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+19:11604:x1875400799122688:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788521831.033388:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927cba5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521831.033419:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927cba5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521831.033431:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927cba5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521831.033646:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927cbac lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521831.033657:0:10083:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927cb5f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ce9 expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521831.033665:0:10083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927cbac lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521831.033700:0:10083:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927cb5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ce9 expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521831.033739:0:10083:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927cb5f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ce9 expref: 20 pid: 5833 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521831.033754:0:10083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc421c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10083:1875400816929536:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788521831.033839:0:10083:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90f5ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521831.037135:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521831.037276:0:10083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc421c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10083:1875400816929536:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788521831.037304:0:10083:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927cbac lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521831.037384:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799122816 00000100:00100000:0.0:1788521831.037391:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799122816 00010000:00010000:0.0:1788521831.037450:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927cb5f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ce9 expref: 21 pid: 5833 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521831.037486:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 85 00000100:00100000:0.0:1788521831.037497:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+21:2363:x1875400799122816:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521831.037513:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521831.037519:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927cb5f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ce9 expref: 21 pid: 5833 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.037539:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927cb5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ce9 expref: 21 pid: 5833 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.037559:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927cb5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ce9 expref: 21 pid: 5833 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.037576:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff996f8687ee00) 00010000:00010000:0.0:1788521831.037581:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927cbac lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.037591:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927cbac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.037616:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927cbac lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.037642:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521831.037700:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+20:2363:x1875400799122816:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 204us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521831.037707:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 85 00010000:00010000:1.0:1788521831.038138:0:10083:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927cbac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521831.038175:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927cbac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788521831.038346:0:10083:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1788521831.038515:0:10083:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1788521831.038562:0:10083:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1788521831.038640:0:10083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d34e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10083:1875400816929664:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788521831.038693:0:10083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521831.038722:0:10083:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fad8040c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521831.038798:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816929664 00000100:00100000:2.0:1788521831.038804:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816929664 00000100:00100000:2.0:1788521831.038858:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788521831.038873:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10083:x1875400816929664:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788521831.038946:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10083:x1875400816929664:12345-0@lo:1000:mdt00_003.0 Request processed in 74us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521831.038953:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788521831.039674:0:10083:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:1.0:1788521831.039681:0:10083:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:1.0:1788521831.039700:0:10083:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff996fb7897b80, transno 4294967321 00000100:00100000:1.0:1788521831.039722:0:10083:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff996fb7895880 x1875400816928768/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788521846 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521831.039735:0:10083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d34e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10083:1875400816929664:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788521831.040348:0:10083:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1788521831.040427:0:10083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d34e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10083:1875400816929792:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788521831.040719:0:10083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521831.040789:0:10083:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fad8049c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521831.040828:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816929792 00000100:00100000:2.0:1788521831.040835:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816929792 00000100:00100000:2.0:1788521831.041086:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788521831.041097:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10083:x1875400816929792:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788521831.041384:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:10083:x1875400816929792:12345-0@lo:1000:mdt00_003.0 Request processed in 288us (664us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788521831.041391:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788521831.041668:0:10083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d34e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10083:1875400816929792:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788521831.041707:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927cbac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.041717:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927cbac lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.041724:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927cbac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.041730:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490a200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521831.041735:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927cbac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.041743:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927cbac lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.041760:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff996f8687ee00) 00010000:00010000:3.0:1788521831.041763:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788521831.041780:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927cbac lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.041787:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927cbac lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.041813:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927caef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.041820:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927caef lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.041826:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927caef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.041832:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392da00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521831.041834:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927caef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.041840:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927caef lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.041848:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:3.0:1788521831.041850:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788521831.041857:0:10083:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927caf6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ccd expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.041939:0:10083:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927caf6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ccd expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.041950:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927caf6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ccd expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.041994:0:10083:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927caf6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ccd expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521831.042088:0:10083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7897b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10083:1875400816929920:192.168.206.48@tcp:105: 00000100:00100000:3.0:1788521831.042330:0:10083:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86759f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788521831.045965:0:10083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7897b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10083:1875400816929920:192.168.206.48@tcp:105: 00010000:00010000:3.0:1788521831.046009:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927caef lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.046021:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927caef lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.046055:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927cbb3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.046069:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927cbb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.046080:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927cbb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.046091:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927cbb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.046097:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927cbb3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.046103:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927cbb3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.046125:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80030400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521831.046131:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927cbb3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.046138:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927cbb3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.046199:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:3.0:1788521831.046202:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521831.046206:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927cbb3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.046211:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927cbb3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.046222:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927cba5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.046227:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927cba5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.046233:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927cba5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.046238:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490ac00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521831.046241:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927cba5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.046247:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927cba5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.046269:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:3.0:1788521831.046272:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788521831.046275:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927cba5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.046280:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ac00/0x1b7b50db5927cba5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521831.047188:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+23:11604:x1875400799122688:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 13870us (14160us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1788521831.047212:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 230 00000020:00080000:2.0:1788521831.047218:0:10083:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788521831.049471:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521831.049530:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799122944 00000100:00100000:0.0:1788521831.049539:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799122944 00000100:00100000:0.0:1788521831.049586:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 61 00000100:00100000:0.0:1788521831.049595:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+23:11603:x1875400799122944:12345-192.168.206.48@tcp:49:lfs.0 00000040:00080000:1.0:1788521831.049612:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788521831.049699:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1788521831.049703:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+23:11603:x1875400799122944:12345-192.168.206.48@tcp:49:lfs.0 Request processed in 109us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521831.049710:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 61 00000040:00080000:1.0:1788521831.051687:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788521831.051706:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788521831.054518:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521831.054603:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521831.054673:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799123456 00000100:00100000:3.0:1788521831.054683:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799123456 00000100:00100000:3.0:1788521831.054746:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 231 00000100:00100000:3.0:1788521831.054757:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+23:11603:x1875400799123456:12345-192.168.206.48@tcp:58:lfs.0 00000040:00080000:3.0:1788521831.055192:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788521831.055272:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+23:11603:x1875400799123456:12345-192.168.206.48@tcp:58:lfs.0 Request processed in 516us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521831.055281:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 231 00000100:00100000:0.0:1788521831.061264:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799123200 00000100:00100000:0.0:1788521831.061280:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799123200 00000100:00100000:0.0:1788521831.061340:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 62 00000100:00100000:0.0:1788521831.061350:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f97fd3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+23:11604:x1875400799123200:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788521831.064574:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788521831.064688:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1788521831.064761:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cbba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.064779:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cbba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.064791:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cbba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.064812:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cbba lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.064819:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cbba lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.064825:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cbba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521831.064849:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788521831.065233:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f97fd3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+25:11604:x1875400799123200:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 3880us (10719us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788521831.065255:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 62 00000020:00080000:0.0:1788521831.065260:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788521831.065753:0:7631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521831.065761:0:7631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cbba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521831.065768:0:7631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4001000 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:1.0:1788521831.065772:0:7631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cbba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521831.065780:0:7631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cbba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521831.065794:0:7631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff996f83d6d700) 00010000:00010000:1.0:1788521831.065797:0:7631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788521831.065802:0:7631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cbba lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521831.065808:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cbba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521831.065830:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521831.065831:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521831.065833:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521831.100400:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521831.100502:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799123584 00000100:00100000:3.0:1788521831.100511:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799123584 00000100:00100000:3.0:1788521831.100568:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 232 00000100:00100000:3.0:1788521831.100578:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+25:11606:x1875400799123584:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521831.100603:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521831.100625:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927cbc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00d05 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.100688:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927cbc8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.100718:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927cbc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.100730:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927cbc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.100749:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927cbcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.100757:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927cbcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.100763:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927cbcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.101132:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927cbd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.101237:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927cae1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cc6 expref: 26 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.101247:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927cbd6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.101282:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927cae1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cc6 expref: 26 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.101303:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927cae1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cc6 expref: 26 pid: 10083 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521831.101329:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7894e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875400816930048:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788521831.101423:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86759f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788521831.105194:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521831.105343:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799123840 00000100:00100000:0.0:1788521831.105351:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799123840 00000100:00100000:0.0:1788521831.105418:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 63 00000100:00100000:0.0:1788521831.105429:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+27:5597:x1875400799123840:12345-192.168.206.48@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788521831.105663:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+28:5597:x1875400799123840:12345-192.168.206.48@tcp:35:ldlm_bl.0 Request processed in 235us (477us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1788521831.105671:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 63 00000100:00100000:2.0:1788521831.105771:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7894e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875400816930048:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788521831.105799:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927cbd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521831.109627:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521831.109711:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799123968 00000100:00100000:3.0:1788521831.109720:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799123968 00010000:00010000:3.0:1788521831.109758:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927cae1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cc6 expref: 28 pid: 10083 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521831.109797:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 86 00000100:00100000:3.0:1788521831.109807:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+28:2363:x1875400799123968:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521831.109821:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521831.109829:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927cae1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cc6 expref: 28 pid: 10083 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.109858:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927cae1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cc6 expref: 28 pid: 10083 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.109887:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490aa00/0x1b7b50db5927cae1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00cc6 expref: 28 pid: 10083 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.109902:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:3.0:1788521831.109907:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927cbd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.109916:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927cbd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.109941:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927cbd6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521831.110247:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521831.110299:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+27:2363:x1875400799123968:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 493us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521831.110307:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 86 00010000:00010000:2.0:1788521831.111662:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927cbd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521831.111676:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927cbd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521831.111719:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788521831.111724:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521831.111745:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927cbd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521831.111762:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927cbd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521831.111772:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927cbc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521831.111780:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927cbc8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521831.111786:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927cbc8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521831.111792:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80030600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521831.111796:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927cbc8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521831.111819:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927cbc8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521831.111833:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:2.0:1788521831.111836:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521831.111842:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927cbc8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521831.112076:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927cbc8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521831.112096:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927cbcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521831.112102:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927cbcf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521831.112107:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927cbcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521831.112112:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80031a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521831.112115:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927cbcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521831.112122:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927cbcf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521831.112132:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff996f8687ee00) 00010000:00010000:2.0:1788521831.112134:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521831.112137:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927cbcf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521831.112181:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927cbcf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521831.112226:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927cbc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d05 expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521831.112241:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927cbd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d05 expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521831.112248:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:2.0:1788521831.112251:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521831.112253:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392da00, rc 0) 00000100:00100000:2.0:1788521831.112378:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+26:11606:x1875400799123584:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 11800us (11986us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521831.112387:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 232 00010000:00010000:3.0:1788521831.567620:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521831.692788:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521831.692840:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521831.692903:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521831.693028:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799124224 00000100:00100000:0.0:1788521831.693038:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799124224 00000100:00100000:0.0:1788521831.693108:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 83 00000100:00100000:0.0:1788521831.693118:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2361:x1875400799124224:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521831.693204:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2361:x1875400799124224:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 86us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521831.693223:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 83 00000100:00080000:1.0:1788521831.693597:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788521831.693839:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799124096 00000100:00100000:3.0:1788521831.693845:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799124096 00000100:00100000:3.0:1788521831.693902:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 287 00000100:00100000:3.0:1788521831.693910:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+13:2361:x1875400799124096:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521831.693950:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8401310-f5ba-4cf2-b118-0866831b1010+13:2361:x1875400799124096:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 41us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521831.693957:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 287 00000100:00100000:3.0:1788521831.693988:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799124352 00000100:00100000:3.0:1788521831.693992:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799124352 00000100:00100000:3.0:1788521831.694031:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 140 00000100:00100000:3.0:1788521831.694038:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2361:x1875400799124352:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521831.694066:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2361:x1875400799124352:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 29us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521831.694072:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 140 00000100:00080000:3.0:1788521831.694092:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521831.760009:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788521831.760032:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816930176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521831.760114:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521831.760511:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816930176 00000100:00100000:3.0:1788521831.760521:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816930176 00000100:00100000:3.0:1788521831.760573:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788521831.760595:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875400816930176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788521831.760618:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1788521831.760672:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875400816930176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521831.760687:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788521831.760910:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816930176:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788521831.985883:0:12562:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788521831.985893:0:12562:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788521831.985939:0:12562:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788521831.985945:0:12562:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788521832.079309:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788521832.079317:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788521832.079358:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788521832.079364:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788521832.079507:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d34a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1875400816930304:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788521832.079598:0:11682:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f922c1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788521832.094765:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521832.094801:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799124480 00000100:00100000:0.0:1788521832.094810:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799124480 00000100:00100000:0.0:1788521832.094858:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 233 00000100:00100000:0.0:1788521832.094868:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadfcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+27:11618:x1875400799124480:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788521832.094903:0:10083:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788521832.094997:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadfcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+27:11618:x1875400799124480:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 130us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521832.095006:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 233 00000100:00100000:3.0:1788521832.095371:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d34a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1875400816930304:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788521832.108010:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521832.116324:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799124736 00000100:00100000:3.0:1788521832.116341:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799124736 00000100:00100000:2.0:1788521832.118647:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 234 00000100:00100000:2.0:1788521832.118660:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+26:11618:x1875400799124736:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521832.118678:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521832.118698:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927cbdd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00d0c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521832.118788:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927cbe4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521832.118822:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927cbe4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521832.118834:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927cbe4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521832.118846:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788521832.119071:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a400/0x1b7b50db5927cbdd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d0c expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521832.119175:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927cbe4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d0c expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521832.119185:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:2.0:1788521832.119188:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521832.119192:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490a200, rc 0) 00000100:00100000:2.0:1788521832.119256:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+28:11618:x1875400799124736:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 598us (11253us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788521832.119262:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 234 00000100:00100000:0.0:1788521832.127771:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521832.127815:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521832.127904:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799125120 00000100:00100000:3.0:1788521832.127914:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799125120 00000100:00100000:3.0:1788521832.127977:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:3.0:1788521832.127986:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f856e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+28:2362:x1875400799125120:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521832.128002:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521832.128025:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a200/0x1b7b50db5927cbe4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d0c expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521832.128042:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:3.0:1788521832.128047:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521832.128092:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f856e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+27:2362:x1875400799125120:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 108us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521832.128100:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:2.0:1788521832.128233:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799124992 00000100:00100000:2.0:1788521832.128238:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799124992 00000100:00100000:2.0:1788521832.128268:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 235 00000100:00100000:2.0:1788521832.128275:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadfcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+27:11618:x1875400799124992:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788521832.128342:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927cbf2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521832.128357:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927cbf2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521832.128379:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927cbf2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521832.128576:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927cbf2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521832.128584:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927cbf2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521832.128590:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927cbf2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521832.128596:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490b000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521832.128600:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927cbf2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521832.128608:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927cbf2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521832.128617:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:2.0:1788521832.128620:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788521832.128623:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927cbf2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521832.128629:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927cbf2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521832.128736:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadfcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+28:11618:x1875400799124992:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 461us (973us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788521832.128744:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 235 00000040:00080000:3.0:1788521832.130530:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788521832.130538:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788521832.131026:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788521832.131034:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788521832.141943:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521832.146625:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799125376 00000100:00100000:0.0:1788521832.146927:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799125376 00000100:00100000:0.0:1788521832.147058:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 64 00000100:00100000:0.0:1788521832.147068:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+28:11618:x1875400799125376:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788521832.147307:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+29:11618:x1875400799125376:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 239us (5374us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1788521832.147315:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 64 00010000:00010000:3.0:1788521832.590391:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521833.619280:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788521833.718238:0:12613:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788521833.718248:0:12613:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788521833.718288:0:12613:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788521833.718293:0:12613:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788521833.873471:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521833.874767:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799125632 00000100:00100000:3.0:1788521833.874785:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799125632 00000100:00100000:3.0:1788521833.874855:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 236 00000100:00100000:3.0:1788521833.874869:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+29:11639:x1875400799125632:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521833.874894:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521833.874915:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927cbf9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00d13 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521833.875008:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927cc00 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521833.875024:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927cc00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521833.875035:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927cc00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521833.875044:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788521833.875181:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392de00/0x1b7b50db5927cbf9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d13 expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521833.875198:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927cc00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d13 expref: 31 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521833.875207:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:3.0:1788521833.875210:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788521833.875215:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392c800, rc 0) 00000100:00100000:3.0:1788521833.875270:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+31:11639:x1875400799125632:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 405us (1805us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788521833.875277:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 236 00000100:00080000:1.0:1788521833.875917:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521833.895930:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521833.898819:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799125760 00000100:00100000:2.0:1788521833.898836:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799125760 00000100:00100000:2.0:1788521833.900902:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 237 00000100:00100000:2.0:1788521833.900922:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+31:11639:x1875400799125760:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:2.0:1788521833.901014:0:10083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927cc0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521833.901032:0:10083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927cc0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521833.901044:0:10083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927cc0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521833.901070:0:10083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927cc0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521833.901077:0:10083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927cc0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521833.901084:0:10083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927cc0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521833.901090:0:10083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490b000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521833.901095:0:10083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927cc0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521833.901103:0:10083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927cc0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521833.901115:0:10083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:2.0:1788521833.901130:0:10083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521833.901136:0:10083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927cc0e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521833.901180:0:10083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b000/0x1b7b50db5927cc0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521833.901259:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+31:11639:x1875400799125760:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 344us (5337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521833.901267:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 237 00000100:00100000:3.0:1788521833.999181:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521833.999229:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799125888 00000100:00100000:0.0:1788521833.999251:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799125888 00000100:00100000:0.0:1788521833.999332:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 71 00000100:00100000:0.0:1788521833.999343:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2362:x1875400799125888:12345-192.168.206.48@tcp:101:cat.0 00010000:00010000:0.0:1788521833.999359:0:11097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521833.999378:0:11097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b70617ee/0x1b7b50db5927cc15 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00d1a expref: -99 pid: 11097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788521833.999417:0:11097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9aad66, atime: 0x6a9aad66, ctime: 0x6a9aad66, blocks: 0xb 00010000:00010000:0.0:1788521833.999436:0:11097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=333s v=(0 0) 00010000:00010000:0.0:1788521833.999441:0:11097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521833.999451:0:11097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b70617ee/0x1b7b50db5927cc15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d1a expref: 8 pid: 11097 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521833.999468:0:11097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b70617ee/0x1b7b50db5927cc15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d1a expref: 8 pid: 11097 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521833.999482:0:11097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4000800, rc 0) 00000100:00100000:0.0:1788521833.999551:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+8:2362:x1875400799125888:12345-192.168.206.48@tcp:101:cat.0 Request processed in 210us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521833.999559:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 71 00000100:00080000:1.0:1788521833.999931:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521834.018604:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521834.018789:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799126016 00000100:00100000:2.0:1788521834.018799:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799126016 00002000:00100000:2.0:1788521834.018859:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff996fadfcf800 x1875400799126016/t0(0) o3->4bd13e8f-aac9-42ad-8625-a542705d6920@192.168.206.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1788521845 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788521834.018871:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff996fadfcf800 with x1875400799126016 ext(0->4095) 00002000:00010000:2.0:1788521834.018876:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996fadfcf800 00000100:00100000:2.0:1788521834.018946:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:2.0:1788521834.018956:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadfcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+8:2363:x1875400799126016:12345-192.168.206.48@tcp:3:cat.0 00000100:00100000:2.0:1788521834.019181:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadfcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+8:2363:x1875400799126016:12345-192.168.206.48@tcp:3:cat.0 Request processed in 225us (585us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788521834.019189:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00002000:00100000:2.0:1788521834.019196:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff996fadfcf800 x1875400799126016/t0(0) o3->4bd13e8f-aac9-42ad-8625-a542705d6920@192.168.206.48@tcp:80/0 lens 488/4536 e 0 to 0 dl 1788521845 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788521834.019205:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff996fadfcf800 with x1875400799126016 ext(0->4095) 00002000:00010000:2.0:1788521834.019208:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff996fadfcf800 00010000:00010000:3.0:1788521834.639810:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521834.831189:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816930432:0@lo:400:kworker.0 00000100:00100000:0.0:1788521834.831276:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521834.832883:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875400816930560:0@lo:400:kworker.0 00000100:00100000:3.0:1788521834.832961:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521834.832990:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad92bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816931072:0@lo:400:kworker.0 00000100:00100000:3.0:1788521834.833019:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521834.833036:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788521834.833042:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875400816930944:0@lo:400:kworker.0 00000100:00100000:3.0:1788521834.833064:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521834.833094:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816930560 00000100:00100000:3.0:1788521834.833101:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816930560 00000100:00100000:3.0:1788521834.833166:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816930944 00000100:00100000:3.0:1788521834.833169:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816930944 00000100:00100000:3.0:1788521834.833201:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788521834.833211:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875400816930560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521834.833260:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875400816930560:12345-0@lo:400:kworker.0 Request processed in 50us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521834.833268:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788521834.833289:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788521834.833296:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875400816930944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521834.833325:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875400816930944:12345-0@lo:400:kworker.0 Request processed in 30us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521834.833330:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788521834.833365:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875400816930944:0@lo:400:kworker.0 00000100:00100000:3.0:1788521834.833376:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875400816930560:0@lo:400:kworker.0 00000100:00100000:1.0:1788521834.834982:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816930432 00000100:00100000:1.0:1788521834.834994:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816930432 00000100:00100000:1.0:1788521834.835052:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788521834.835062:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3304:x1875400816930432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521834.835128:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3304:x1875400816930432:12345-0@lo:400:kworker.0 Request processed in 68us (3852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521834.835135:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00080000:1.0:1788521834.835199:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521834.835344:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875400816930688:0@lo:400:kworker.0 00000100:00100000:0.0:1788521834.835383:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521834.835443:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521834.835450:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816930816:0@lo:400:kworker.0 00000100:00100000:0.0:1788521834.835476:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521834.835505:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816931072 00000100:00100000:0.0:1788521834.835509:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816931072 00000100:00100000:0.0:1788521834.835542:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816930816 00000100:00100000:0.0:1788521834.835545:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816930816 00000100:00100000:0.0:1788521834.835567:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788521834.835573:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82bb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875400816931072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521834.835624:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82bb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875400816931072:12345-0@lo:400:kworker.0 Request processed in 50us (2603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521834.835631:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788521834.835647:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788521834.835653:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb791ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1875400816930816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521834.835686:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb791ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1875400816930816:12345-0@lo:400:kworker.0 Request processed in 33us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521834.835692:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788521834.835726:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816930816:0@lo:400:kworker.0 00000100:00100000:0.0:1788521834.835756:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816930432:0@lo:400:kworker.0 00000100:00100000:3.0:1788521834.835784:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad92bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816931072:0@lo:400:kworker.0 00000100:00080000:1.0:1788521834.836951:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788521834.836957:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521834.837079:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816930688 00000100:00100000:2.0:1788521834.837087:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816930688 00000100:00100000:2.0:1788521834.837179:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788521834.837187:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fadfcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875400816930688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521834.837258:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fadfcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875400816930688:12345-0@lo:400:kworker.0 Request processed in 72us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521834.837264:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788521834.837317:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875400816930688:0@lo:400:kworker.0 00000100:00080000:1.0:1788521834.837384:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521835.342260:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788521835.342282:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc423100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816931200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521835.342361:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521835.342436:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816931200 00000100:00100000:1.0:1788521835.342446:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816931200 00000100:00100000:1.0:1788521835.342520:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788521835.342534:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875400816931200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521835.342569:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521835.342627:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875400816931200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521835.349622:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788521835.349730:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc423100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816931200:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788521835.663032:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788521835.914456:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1788521836.456521:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:1.0:1788521836.456547:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1788521836.456576:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:3.0:1788521836.459914:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:3.0:1788521836.459936:0:5856:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff996fad8040c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788521836.459942:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff996f98801500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff996fad804540 00000020:00080000:3.0:1788521836.459946:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff996f98801300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff996fbc45fc00 00000001:00080000:3.0:1788521836.459978:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1788521836.459989:0:5856:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1788521836.460037:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1788521836.460285:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1788521836.686493:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521836.815913:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521836.815958:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521836.815986:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521836.816004:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521836.816028:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521836.816077:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799126272 00000100:00100000:0.0:1788521836.816090:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799126272 00000100:00100000:0.0:1788521836.816179:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799126656 00000100:00100000:0.0:1788521836.816182:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799126656 00000100:00100000:0.0:1788521836.816208:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 144 00000100:00100000:0.0:1788521836.816220:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb791ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+18:2364:x1875400799126272:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521836.816314:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb791ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+18:2364:x1875400799126272:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 96us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521836.816322:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 144 00000100:00100000:0.0:1788521836.816346:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 145 00000100:00100000:0.0:1788521836.816354:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb42d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2364:x1875400799126656:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521836.816392:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb42d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2364:x1875400799126656:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 25us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521836.816399:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 145 00000100:00100000:0.0:1788521836.816422:0:12322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799126528 00000100:00100000:0.0:1788521836.816427:0:12322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799126528 00000100:00100000:0.0:1788521836.816458:0:12322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799126400 00000100:00100000:0.0:1788521836.816461:0:12322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799126400 00000100:00100000:0.0:1788521836.816485:0:12322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 86 00000100:00100000:0.0:1788521836.816492:0:12322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2364:x1875400799126528:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521836.816521:0:12322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2364:x1875400799126528:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 30us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521836.816527:0:12322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 86 00000100:00100000:0.0:1788521836.816539:0:12322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 87 00000100:00100000:0.0:1788521836.816545:0:12322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb42daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2364:x1875400799126400:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521836.816567:0:12322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb42daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2364:x1875400799126400:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 23us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521836.816582:0:12322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 87 00000100:00100000:0.0:1788521836.816604:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799126144 00000100:00100000:0.0:1788521836.816608:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799126144 00000100:00100000:0.0:1788521836.816636:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 289 00000100:00100000:0.0:1788521836.816642:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+13:2364:x1875400799126144:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521836.817920:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+13:2364:x1875400799126144:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 1268us (1922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521836.817934:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 289 00000100:00080000:0.0:1788521836.818006:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788521836.818013:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788521836.818017:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521836.883894:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816931328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521836.883969:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521836.884074:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816931328 00000100:00100000:2.0:1788521836.884082:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816931328 00000100:00100000:2.0:1788521836.884168:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788521836.884178:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb42db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816931328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788521836.884213:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521836.884262:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb42db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816931328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521836.884269:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788521836.884309:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1788521836.884314:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff996fb7895880, transno 4294967322 00000004:00080000:2.0:1788521836.884323:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1788521836.884350:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816931328:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788521836.884444:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788521837.710682:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521838.736441:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521839.637691:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521839.637833:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799126784 00000100:00100000:0.0:1788521839.637843:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799126784 00000100:00100000:0.0:1788521839.637918:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 238 00000100:00100000:0.0:1788521839.637929:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+18:11292:x1875400799126784:12345-192.168.206.48@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788521839.638034:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+18:11292:x1875400799126784:12345-192.168.206.48@tcp:60:lhsmtool_posix.0 Request processed in 105us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521839.638041:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 238 00000100:00080000:1.0:1788521839.638516:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521839.653257:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521839.653399:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799127040 00000100:00100000:3.0:1788521839.653410:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799127040 00000100:00100000:3.0:1788521839.653460:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 65 00000100:00100000:3.0:1788521839.653471:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+18:11292:x1875400799127040:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788521839.653789:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+19:11292:x1875400799127040:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 319us (538us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788521839.653797:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 65 00010000:00010000:2.0:1788521839.758695:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521839.950680:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb4a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816931840:0@lo:400:kworker.0 00000100:00100000:2.0:1788521839.950750:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521839.950824:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788521839.950844:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc423100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875400816931712:0@lo:400:kworker.0 00000100:00100000:2.0:1788521839.950888:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521839.951175:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816931456:0@lo:400:kworker.0 00000100:00100000:0.0:1788521839.951214:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521839.951237:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb4a66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875400816931968:0@lo:400:kworker.0 00000100:00100000:0.0:1788521839.951267:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521839.951285:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788521839.951291:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816931584:0@lo:400:kworker.0 00000100:00100000:0.0:1788521839.951310:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521839.951324:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb4a65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816932096:0@lo:400:kworker.0 00000100:00100000:0.0:1788521839.951343:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521839.951381:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816931712 00000100:00100000:0.0:1788521839.951389:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816931712 00000100:00100000:0.0:1788521839.951454:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816931968 00000100:00100000:0.0:1788521839.951458:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816931968 00000100:00100000:0.0:1788521839.951475:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816931584 00000100:00100000:0.0:1788521839.951478:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816931584 00000100:00100000:0.0:1788521839.951491:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788521839.951508:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad6fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875400816931712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521839.951563:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad6fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875400816931712:12345-0@lo:400:kworker.0 Request processed in 64us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521839.951569:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788521839.951590:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788521839.951596:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875400816931968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521839.951626:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875400816931968:12345-0@lo:400:kworker.0 Request processed in 31us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521839.951641:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788521839.951644:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816931840 00000100:00100000:1.0:1788521839.951648:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816931840 00000100:00100000:0.0:1788521839.951654:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788521839.951659:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816931584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521839.951676:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816932096 00000100:00100000:1.0:1788521839.951679:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816932096 00000100:00100000:0.0:1788521839.951685:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816931584:12345-0@lo:400:kworker.0 Request processed in 26us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521839.951698:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788521839.951700:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788521839.951705:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816931840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521839.951724:0:12322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788521839.951730:0:12322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816932096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521839.951738:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816931840:12345-0@lo:400:kworker.0 Request processed in 35us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521839.951743:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788521839.951755:0:12322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816932096:12345-0@lo:400:kworker.0 Request processed in 26us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521839.951761:0:12322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1788521839.951774:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788521839.951778:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788521839.951780:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521839.951796:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc423100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875400816931712:0@lo:400:kworker.0 00000100:00100000:0.0:1788521839.951796:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816931584:0@lo:400:kworker.0 00000100:00100000:0.0:1788521839.951804:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000100:00100000:1.0:1788521839.951807:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb4a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816931840:0@lo:400:kworker.0 00000004:00080000:0.0:1788521839.951809:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff996fb7896300, transno 4294967310 00000100:00100000:0.0:1788521839.952040:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb4a65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816932096:0@lo:400:kworker.0 00000100:00100000:0.0:1788521839.952056:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb4a66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875400816931968:0@lo:400:kworker.0 00000100:00100000:2.0:1788521839.952127:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816931456 00000100:00100000:2.0:1788521839.952132:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816931456 00000100:00100000:2.0:1788521839.952188:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788521839.952195:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3304:x1875400816931456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521839.952234:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3304:x1875400816931456:12345-0@lo:400:kworker.0 Request processed in 40us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521839.952239:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788521839.953210:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816931456:0@lo:400:kworker.0 00000100:00100000:2.0:1788521840.033877:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521840.033959:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799127168 00000100:00100000:0.0:1788521840.033968:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799127168 00000100:00100000:0.0:1788521840.034055:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 239 00000100:00100000:0.0:1788521840.034066:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad6fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:12092:x1875400799127168:12345-192.168.206.48@tcp:101:lsof.0 00010000:00010000:0.0:1788521840.034092:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521840.034116:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cc1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00d21 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521840.034206:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927cc23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521840.034220:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927cc23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521840.034247:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927cc23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521840.034282:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788521840.034285:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788521840.034306:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927cc23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521840.034329:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001000/0x1b7b50db5927cc1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d21 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521840.034346:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927cc23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d21 expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521840.034355:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fa0d5ca00) 00010000:00010000:0.0:1788521840.034357:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788521840.034372:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4000a00, rc 0) 00000100:00100000:0.0:1788521840.034439:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad6fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e406c42-03a1-40c3-937c-c3b114a3dde8+6:12092:x1875400799127168:12345-192.168.206.48@tcp:101:lsof.0 Request processed in 375us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521840.034446:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 239 00000100:00080000:1.0:1788521840.034740:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788521840.334961:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788521840.334970:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788521840.335248:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1788521840.335262:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788521840.464017:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788521840.464038:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816932224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521840.464126:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521840.464323:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816932224 00000100:00100000:2.0:1788521840.464331:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816932224 00000100:00100000:2.0:1788521840.464390:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788521840.464400:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816932224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788521840.464432:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521840.464483:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816932224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521840.464490:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788521840.464575:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816932224:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788521840.783666:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788521841.531737:0:5856:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:3.0:1788521841.531771:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1788521841.531816:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1788521841.531827:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788521841.808217:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521841.937751:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521841.937803:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521841.937898:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799127296 00000100:00100000:0.0:1788521841.937909:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799127296 00000100:00100000:0.0:1788521841.937963:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 291 00000100:00100000:0.0:1788521841.937985:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+13:2361:x1875400799127296:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521841.938123:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799127424 00000100:00100000:2.0:1788521841.938127:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799127424 00000100:00100000:2.0:1788521841.938201:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 149 00000100:00100000:2.0:1788521841.938208:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+18:2361:x1875400799127424:12345-192.168.206.48@tcp:400:kworker.0 00000100:00080000:3.0:1788521841.938302:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521841.938380:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+13:2361:x1875400799127296:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 396us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521841.938388:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 291 00000100:00100000:2.0:1788521841.938487:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+18:2361:x1875400799127424:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 278us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521841.938493:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 149 00000100:00100000:3.0:1788521841.942550:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521841.942589:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521841.942619:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521841.942699:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799127552 00000100:00100000:0.0:1788521841.942708:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799127552 00000100:00100000:0.0:1788521841.942776:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799127680 00000100:00100000:0.0:1788521841.942779:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799127680 00000100:00100000:0.0:1788521841.942810:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 90 00000100:00100000:0.0:1788521841.942819:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2361:x1875400799127552:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521841.942884:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2361:x1875400799127552:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 67us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521841.942891:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 90 00000100:00100000:0.0:1788521841.942907:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 91 00000100:00100000:0.0:1788521841.942913:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2361:x1875400799127680:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521841.942931:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2361:x1875400799127680:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 19us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521841.942937:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 91 00000100:00080000:3.0:1788521841.943421:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788521841.943436:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521841.943527:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799127808 00000100:00100000:1.0:1788521841.943531:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799127808 00000100:00100000:1.0:1788521841.943568:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 150 00000100:00100000:1.0:1788521841.943575:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e406c42-03a1-40c3-937c-c3b114a3dde8+6:2361:x1875400799127808:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521841.943617:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e406c42-03a1-40c3-937c-c3b114a3dde8+6:2361:x1875400799127808:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 43us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521841.943624:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 150 00000100:00100000:0.0:1788521841.998552:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816932352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521841.998630:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521841.998772:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816932352 00000100:00100000:2.0:1788521841.998780:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816932352 00000100:00100000:2.0:1788521841.998852:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788521841.998860:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816932352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788521841.998893:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521841.998933:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816932352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521841.998940:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788521841.999020:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816932352:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788521841.999210:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788521842.830693:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521843.855174:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788521844.540140:0:12815:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 07:37:23 (1788521843) 00010000:00010000:3.0:1788521844.878331:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521845.070777:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82bb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816932480:0@lo:400:kworker.0 00000100:00100000:0.0:1788521845.070868:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521845.070917:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82bb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875400816932992:0@lo:400:kworker.0 00000100:00100000:0.0:1788521845.070962:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521845.070989:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788521845.070995:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82bb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816932608:0@lo:400:kworker.0 00000100:00100000:0.0:1788521845.071018:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521845.071037:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82bb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816933120:0@lo:400:kworker.0 00000100:00100000:0.0:1788521845.071306:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521845.071351:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82bb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816932864:0@lo:400:kworker.0 00000100:00100000:0.0:1788521845.072280:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521845.072309:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788521845.072317:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875400816932736:0@lo:400:kworker.0 00000100:00100000:0.0:1788521845.072365:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521845.072410:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816932480 00000100:00100000:0.0:1788521845.072418:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816932480 00000100:00100000:0.0:1788521845.072461:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788521845.072470:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3304:x1875400816932480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521845.072521:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3304:x1875400816932480:12345-0@lo:400:kworker.0 Request processed in 52us (1654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521845.072527:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788521845.072560:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816932992 00000100:00100000:0.0:1788521845.072564:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816932992 00000100:00100000:0.0:1788521845.072595:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816932608 00000100:00100000:0.0:1788521845.072598:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816932608 00000100:00100000:2.0:1788521845.072996:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816932736 00000100:00100000:2.0:1788521845.073001:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816932736 00000100:00100000:2.0:1788521845.073026:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788521845.073032:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875400816932992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521845.073081:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875400816932992:12345-0@lo:400:kworker.0 Request processed in 49us (2119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521845.073088:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788521845.073100:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788521845.073106:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875400816932736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521845.073138:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875400816932736:12345-0@lo:400:kworker.0 Request processed in 33us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521845.073159:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788521845.074563:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816933120 00000100:00100000:1.0:1788521845.074572:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816933120 00000100:00100000:0.0:1788521845.074986:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788521845.074995:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816932608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521845.075156:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816932864 00000100:00100000:1.0:1788521845.075161:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816932864 00000100:00100000:1.0:1788521845.075186:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788521845.075193:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816933120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521845.075249:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816932608:12345-0@lo:400:kworker.0 Request processed in 255us (4229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521845.075268:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:0.0:1788521845.075294:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788521845.075298:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788521845.075300:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521845.075312:0:12322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788521845.075318:0:12322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816932864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521845.077279:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816933120:12345-0@lo:400:kworker.0 Request processed in 2081us (6212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521845.077291:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788521845.077677:0:12322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816932864:12345-0@lo:400:kworker.0 Request processed in 2357us (5396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521845.077685:0:12322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788521845.083244:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875400816932736:0@lo:400:kworker.0 00000100:00100000:3.0:1788521845.083264:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82bb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816932864:0@lo:400:kworker.0 00000100:00100000:3.0:1788521845.083316:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82bb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816932608:0@lo:400:kworker.0 00000100:00100000:3.0:1788521845.083329:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82bb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816933120:0@lo:400:kworker.0 00000100:00100000:3.0:1788521845.083350:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82bb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816932480:0@lo:400:kworker.0 00000100:00100000:3.0:1788521845.083363:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82bb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875400816932992:0@lo:400:kworker.0 00000100:00100000:3.0:1788521845.591344:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816933248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521845.591436:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521845.591526:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816933248 00000100:00100000:3.0:1788521845.591534:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816933248 00000100:00100000:3.0:1788521845.591578:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788521845.591587:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4b61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816933248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788521845.591623:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521845.598079:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4b61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816933248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6483us (6633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521845.598093:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788521845.598320:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816933248:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788521845.903160:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521846.926474:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521847.056570:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521847.056616:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521847.056651:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521847.056681:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521847.056736:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521847.056765:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799128448 00000100:00100000:3.0:1788521847.056786:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799128448 00000100:00100000:3.0:1788521847.056840:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799128064 00000100:00100000:3.0:1788521847.056855:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799128064 00000100:00100000:3.0:1788521847.056881:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 154 00000100:00100000:3.0:1788521847.056890:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e406c42-03a1-40c3-937c-c3b114a3dde8+6:2362:x1875400799128448:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521847.057427:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 155 00000100:00100000:1.0:1788521847.057439:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+18:2362:x1875400799128064:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521847.057484:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+18:2362:x1875400799128064:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 48us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521847.057491:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 155 00000100:00080000:1.0:1788521847.057537:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521847.057549:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799128192 00000100:00100000:1.0:1788521847.057553:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799128192 00000100:00100000:1.0:1788521847.057585:0:11097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799128320 00000100:00100000:1.0:1788521847.057588:0:11097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799128320 00000100:00100000:1.0:1788521847.057612:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 94 00000100:00100000:1.0:1788521847.057619:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2362:x1875400799128192:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521847.057647:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2362:x1875400799128192:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 29us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521847.057654:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 94 00000100:00100000:1.0:1788521847.057667:0:11097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 95 00000100:00100000:1.0:1788521847.057673:0:11097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82bb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2362:x1875400799128320:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521847.057696:0:11097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82bb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2362:x1875400799128320:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 24us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521847.057702:0:11097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 95 00000100:00080000:1.0:1788521847.057722:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788521847.057724:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521847.058514:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e406c42-03a1-40c3-937c-c3b114a3dde8+6:2362:x1875400799128448:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 70us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521847.058524:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 154 00000100:00100000:0.0:1788521847.059274:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799127936 00000100:00100000:0.0:1788521847.059284:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799127936 00000100:00100000:0.0:1788521847.059361:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 293 00000100:00100000:0.0:1788521847.059371:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+13:2362:x1875400799127936:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521847.059438:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8401310-f5ba-4cf2-b118-0866831b1010+13:2362:x1875400799127936:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 69us (2877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521847.059445:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 293 00000100:00100000:3.0:1788521847.118739:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788521847.118763:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816933376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521847.118906:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521847.119037:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816933376 00000100:00100000:1.0:1788521847.119046:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816933376 00000100:00100000:1.0:1788521847.119109:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788521847.119119:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816933376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788521847.119175:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521847.119221:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816933376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521847.119241:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1788521847.119491:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521847.119569:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816933376:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788521847.952140:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521848.765782:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521848.766523:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799128704 00000100:00100000:0.0:1788521848.766534:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799128704 00000100:00100000:0.0:1788521848.766595:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 66 00000100:00100000:0.0:1788521848.766605:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+18:12313:x1875400799128704:12345-192.168.206.48@tcp:35:umount.0 00000100:00100000:0.0:1788521848.767259:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+19:12313:x1875400799128704:12345-192.168.206.48@tcp:35:umount.0 Request processed in 653us (1483us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1788521848.767268:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 66 00000100:00100000:3.0:1788521848.777732:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521848.780182:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799128960 00000100:00100000:0.0:1788521848.780211:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799128960 00000100:00100000:0.0:1788521848.780275:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 67 00000100:00100000:0.0:1788521848.780284:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+19:12313:x1875400799128960:12345-192.168.206.48@tcp:35:umount.0 00000100:00100000:0.0:1788521848.780635:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+20:12313:x1875400799128960:12345-192.168.206.48@tcp:35:umount.0 Request processed in 351us (2912us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788521848.780643:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 67 00000100:00100000:1.0:1788521848.788810:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521848.788884:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799129216 00000100:00100000:0.0:1788521848.788893:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799129216 00000100:00100000:0.0:1788521848.788954:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 68 00000100:00100000:0.0:1788521848.788963:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f97fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+20:12313:x1875400799129216:12345-192.168.206.48@tcp:35:umount.0 00000100:00100000:0.0:1788521848.789735:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f97fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bd13e8f-aac9-42ad-8625-a542705d6920+21:12313:x1875400799129216:12345-192.168.206.48@tcp:35:umount.0 Request processed in 770us (929us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788521848.789743:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 68 00000100:00100000:1.0:1788521848.809261:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521848.809513:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799129472 00000100:00100000:2.0:1788521848.809523:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799129472 00000100:00100000:2.0:1788521848.809579:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 69 00000100:00100000:2.0:1788521848.809589:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+21:12313:x1875400799129472:12345-192.168.206.48@tcp:35:umount.0 00000100:00100000:2.0:1788521848.809915:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+22:12313:x1875400799129472:12345-192.168.206.48@tcp:35:umount.0 Request processed in 327us (662us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788521848.809939:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 69 00000100:00100000:3.0:1788521848.818829:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521848.818924:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799129600 00000100:00100000:1.0:1788521848.818932:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799129600 00000100:00100000:1.0:1788521848.818986:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:1.0:1788521848.818994:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8401310-f5ba-4cf2-b118-0866831b1010+13:2361:x1875400799129600:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521848.819007:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521848.819032:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8392ce00/0x1b7b50db5927bc39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008ac expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521848.819049:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521848.819511:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8401310-f5ba-4cf2-b118-0866831b1010+12:2361:x1875400799129600:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 516us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521848.819519:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:1.0:1788521848.822188:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521848.822309:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799129728 00000100:00100000:3.0:1788521848.822327:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799129728 00000100:00100000:3.0:1788521848.822387:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:3.0:1788521848.822396:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8401310-f5ba-4cf2-b118-0866831b1010+12:2362:x1875400799129728:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521848.822418:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521848.822441:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8149d200/0x1b7b50db5927bc01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00874 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521848.822456:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521848.822516:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8401310-f5ba-4cf2-b118-0866831b1010+11:2362:x1875400799129728:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 122us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521848.822524:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:2.0:1788521848.827309:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521848.827361:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521848.827431:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799129984 00000100:00100000:3.0:1788521848.827440:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799129984 00000100:00100000:3.0:1788521848.827538:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:3.0:1788521848.827548:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad6fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8401310-f5ba-4cf2-b118-0866831b1010+11:2362:x1875400799129984:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521848.827564:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521848.827582:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8392c000/0x1b7b50db5927beaf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00977 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521848.827599:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521848.827655:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad6fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8401310-f5ba-4cf2-b118-0866831b1010+10:2362:x1875400799129984:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 109us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521848.827662:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:0.0:1788521848.827853:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799129856 00000100:00100000:0.0:1788521848.827857:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799129856 00000100:00100000:0.0:1788521848.827896:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 72 00000100:00100000:0.0:1788521848.827903:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad6fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2360:x1875400799129856:12345-192.168.206.48@tcp:9:umount.0 00000020:00000080:0.0:1788521848.827926:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927bf73 00000100:00080000:0.0:1788521848.827935:0:6687:0:(import.c:65:import_set_state_nolock()) ffff996f9ec06800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788521848.827970:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788521848.828201:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad6fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+2:2360:x1875400799129856:12345-192.168.206.48@tcp:9:umount.0 Request processed in 297us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521848.828208:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 72 00010000:00010000:0.0:1788521848.828239:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521848.837940:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521848.838021:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799130368 00000100:00100000:1.0:1788521848.838029:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799130368 00000100:00100000:1.0:1788521848.838086:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 73 00000100:00100000:1.0:1788521848.838095:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad6fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+7:2360:x1875400799130368:12345-192.168.206.48@tcp:9:umount.0 00000020:00000080:1.0:1788521848.838268:0:6690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927c1d4 00000020:00010000:1.0:1788521848.838276:0:6690:0:(genops.c:1921:obd_stale_export_put()) Put export ffff996fb46eb000: total 0 00000100:00080000:1.0:1788521848.838282:0:6690:0:(import.c:65:import_set_state_nolock()) ffff996fb46ed000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788521848.838343:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1788521848.838600:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad6fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bd13e8f-aac9-42ad-8625-a542705d6920+5:2360:x1875400799130368:12345-192.168.206.48@tcp:9:umount.0 Request processed in 504us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521848.838628:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 73 00000020:00010000:3.0:1788521848.838761:0:5821:0:(genops.c:1907:obd_stale_export_get()) Get export ffff996fb46eb000: total 0 00010000:00010000:3.0:1788521848.838805:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff996fb46eb000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788521848.838859:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b70617ee/0x1b7b50db5927cc15 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d1a expref: 4 pid: 11097 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521848.838892:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc7be9d4/0x1b7b50db5927c577 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b4c expref: 3 pid: 11097 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521848.838906:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff996fb46eb000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788521848.838919:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521848.838921:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521848.838923:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521848.847053:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521848.847138:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799131392 00000100:00100000:1.0:1788521848.847180:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799131392 00000100:00100000:1.0:1788521848.847251:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 240 00000100:00100000:1.0:1788521848.847268:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+22:2360:x1875400799131392:12345-192.168.206.48@tcp:39:umount.0 00000020:00000080:1.0:1788521848.847301:0:5833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927bc0f 00000020:00010000:1.0:1788521848.847331:0:5833:0:(genops.c:1921:obd_stale_export_put()) Put export ffff996fb47c9000: total 0 00000100:00080000:1.0:1788521848.847336:0:5833:0:(import.c:65:import_set_state_nolock()) ffff996fb47cc000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788521848.847366:0:5833:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:3.0:1788521848.847393:0:5822:0:(genops.c:1907:obd_stale_export_get()) Get export ffff996fb47c9000: total 0 00010000:00010000:3.0:1788521848.847561:0:5822:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff996fb47c9000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788521848.847592:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff996fa0d5ce00) 00010000:00010000:3.0:1788521848.847609:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788521848.847617:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4c00/0x1b7b50db5927bed9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00985 expref: 22 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521848.847644:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:3.0:1788521848.847647:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788521848.847652:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927c562 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b45 expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521848.847667:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:3.0:1788521848.847669:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788521848.847673:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001e00/0x1b7b50db5927c8d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00c41 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521848.847683:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:3.0:1788521848.847685:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788521848.847688:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392c800/0x1b7b50db5927cc00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d13 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521848.847699:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:3.0:1788521848.847702:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788521848.847705:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001600/0x1b7b50db5927c236 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00a73 expref: 17 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521848.847716:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff996f83d6d400) 00010000:00010000:3.0:1788521848.847718:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788521848.847733:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001a00/0x1b7b50db5927c5f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b6f expref: 16 pid: 10083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521848.847735:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bd13e8f-aac9-42ad-8625-a542705d6920+16:2360:x1875400799131392:12345-192.168.206.48@tcp:39:umount.0 Request processed in 475us (693us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1788521848.847743:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 240 00010000:00010000:3.0:1788521848.847750:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:3.0:1788521848.847752:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788521848.847756:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4600/0x1b7b50db5927c458 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00aff expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521848.847779:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996fb19ef700) 00010000:00010000:3.0:1788521848.847782:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788521848.847786:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490a800/0x1b7b50db5927bf49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd009a1 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521848.848054:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:1.0:1788521848.848057:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788521848.848062:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927caf6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ccd expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521848.848075:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996fb19efc00) 00010000:00010000:1.0:1788521848.848078:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521848.848081:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b800/0x1b7b50db5927bef5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd0098c expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521848.848106:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff996fb19ef100) 00010000:00010000:1.0:1788521848.848108:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521848.848111:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f8392da00/0x1b7b50db5927cbd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d05 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521848.848186:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fa0d5ca00) 00010000:00010000:1.0:1788521848.848189:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788521848.848194:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4200/0x1b7b50db5927c5d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b68 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521848.848218:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996fa0d5c300) 00010000:00010000:1.0:1788521848.848220:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521848.848224:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b200/0x1b7b50db5927c538 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00b37 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521848.848237:0:5822:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff996fb47c9000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1788521848.848255:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521848.848257:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521848.848259:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521848.976466:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521849.998670:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521850.190545:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816933888:0@lo:400:kworker.0 00000100:00100000:2.0:1788521850.190612:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521850.190670:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788521850.190676:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875400816933760:0@lo:400:kworker.0 00000100:00100000:2.0:1788521850.190699:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521850.190733:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816933888 00000100:00100000:2.0:1788521850.190740:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816933888 00000100:00100000:3.0:1788521850.190892:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816933504:0@lo:400:kworker.0 00000100:00100000:3.0:1788521850.190927:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521850.190952:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875400816934016:0@lo:400:kworker.0 00000100:00100000:3.0:1788521850.190974:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521850.191003:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788521850.191008:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816933632:0@lo:400:kworker.0 00000100:00100000:3.0:1788521850.191032:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521850.191049:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816934144:0@lo:400:kworker.0 00000100:00100000:3.0:1788521850.191067:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521850.191104:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816933504 00000100:00100000:3.0:1788521850.191108:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816933504 00000100:00100000:3.0:1788521850.191166:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788521850.191176:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3304:x1875400816933504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521850.191250:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3304:x1875400816933504:12345-0@lo:400:kworker.0 Request processed in 75us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521850.191257:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788521850.191329:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816933504:0@lo:400:kworker.0 00000100:00100000:3.0:1788521850.191359:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816933760 00000100:00100000:3.0:1788521850.191362:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816933760 00000100:00100000:3.0:1788521850.191387:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816934016 00000100:00100000:3.0:1788521850.191391:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816934016 00000100:00100000:3.0:1788521850.191406:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788521850.191413:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad6fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875400816933760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521850.191450:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad6fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875400816933760:12345-0@lo:400:kworker.0 Request processed in 37us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521850.191456:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788521850.191467:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816933632 00000100:00100000:3.0:1788521850.191470:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816933632 00000100:00100000:3.0:1788521850.191484:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788521850.191489:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875400816934016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521850.191521:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875400816934016:12345-0@lo:400:kworker.0 Request processed in 32us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521850.191527:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788521850.191540:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788521850.191547:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82bb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816933632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521850.191573:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82bb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816933632:12345-0@lo:400:kworker.0 Request processed in 27us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521850.191579:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788521850.191609:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875400816933760:0@lo:400:kworker.0 00000100:00100000:3.0:1788521850.191642:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816933632:0@lo:400:kworker.0 00000100:00100000:3.0:1788521850.191651:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875400816934016:0@lo:400:kworker.0 00000100:00080000:3.0:1788521850.191683:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788521850.191687:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521850.191697:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816934144 00000100:00100000:3.0:1788521850.191700:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816934144 00000100:00100000:3.0:1788521850.191730:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788521850.191738:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad6fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816933888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521850.191773:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad6fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816933888:12345-0@lo:400:kworker.0 Request processed in 36us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521850.191779:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788521850.191803:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788521850.191810:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816934144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521850.191840:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816934144:12345-0@lo:400:kworker.0 Request processed in 31us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521850.191845:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:3.0:1788521850.191859:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788521850.191875:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816933888:0@lo:400:kworker.0 00000100:00100000:3.0:1788521850.191898:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816934144:0@lo:400:kworker.0 00000040:00080000:1.0:1788521850.577502:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788521850.577524:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788521850.577916:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788521850.577924:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788521850.702491:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788521850.702525:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816934272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521850.702592:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521850.702958:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816934272 00000100:00100000:1.0:1788521850.702967:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816934272 00000100:00100000:1.0:1788521850.703022:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788521850.703032:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816934272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521850.703065:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521850.703346:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816934272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 315us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521850.703355:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788521850.710720:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816934272:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788521851.023418:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788521851.257126:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4bd13e8f-aac9-42ad-8625-a542705d6920 00000020:00000080:3.0:1788521851.257134:0:7647:0:(genops.c:885:class_export_put()) final put ffff996f9ec07800/4bd13e8f-aac9-42ad-8625-a542705d6920 00000020:00000080:0.0:1788521851.257272:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff996f9ec07800/4bd13e8f-aac9-42ad-8625-a542705d6920 for lustre-OST0001 00000020:00000080:0.0:1788521851.257324:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff996f9ec06800 for lustre-OST0001 00000100:00100000:2.0:1788521851.591575:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521851.592487:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521851.592539:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521851.592643:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799131648 00000100:00100000:0.0:1788521851.592651:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799131648 00000100:00100000:0.0:1788521851.592708:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799131520 00000100:00100000:0.0:1788521851.592711:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799131520 00000100:00100000:0.0:1788521851.592726:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799131776 00000100:00100000:0.0:1788521851.592729:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799131776 00000100:00100000:0.0:1788521851.592744:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:0.0:1788521851.592752:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad6ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8401310-f5ba-4cf2-b118-0866831b1010+12:2363:x1875400799131648:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521851.592766:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521851.592785:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f80031600/0x1b7b50db5927bce8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008eb expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521851.592802:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521851.592853:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad6ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8401310-f5ba-4cf2-b118-0866831b1010+11:2363:x1875400799131648:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 101us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521851.592860:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:0.0:1788521851.592876:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:0.0:1788521851.592881:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad6fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8401310-f5ba-4cf2-b118-0866831b1010+10:2364:x1875400799131520:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521851.592889:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521851.592898:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f80030c00/0x1b7b50db5927bce1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008c1 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521851.592906:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521851.592924:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad6fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8401310-f5ba-4cf2-b118-0866831b1010+9:2364:x1875400799131520:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 42us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521851.592930:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:0.0:1788521851.592957:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:0.0:1788521851.592963:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad6fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8401310-f5ba-4cf2-b118-0866831b1010+8:2364:x1875400799131776:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521851.592972:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521851.592981:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996fc217d400/0x1b7b50db5927bea8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00970 expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521851.592990:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521851.593007:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad6fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8401310-f5ba-4cf2-b118-0866831b1010+7:2364:x1875400799131776:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 44us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521851.593013:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:2.0:1788521851.613383:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521851.613630:0:10083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799132032 00000100:00100000:3.0:1788521851.613650:0:10083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799132032 00000100:00100000:3.0:1788521851.613728:0:10083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 241 00000100:00100000:3.0:1788521851.613739:0:10083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad6fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e406c42-03a1-40c3-937c-c3b114a3dde8+6:2360:x1875400799132032:12345-192.168.206.48@tcp:39:umount.0 00000020:00000080:3.0:1788521851.613774:0:10083:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927bcf6 00000020:00010000:3.0:1788521851.613781:0:10083:0:(genops.c:1921:obd_stale_export_put()) Put export ffff996f87cae800: total 0 00000100:00080000:3.0:1788521851.613785:0:10083:0:(import.c:65:import_set_state_nolock()) ffff996f87cad000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788521851.613815:0:10083:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1788521851.614033:0:10083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad6fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e406c42-03a1-40c3-937c-c3b114a3dde8+5:2360:x1875400799132032:12345-192.168.206.48@tcp:39:umount.0 Request processed in 295us (658us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788521851.614040:0:10083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 241 00000020:00010000:1.0:1788521851.614456:0:7631:0:(genops.c:1907:obd_stale_export_get()) Get export ffff996f87cae800: total 0 00010000:00010000:1.0:1788521851.614460:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521851.614499:0:7631:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff996f87cae800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788521851.614527:0:7631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fa0d5ca00) 00010000:00010000:1.0:1788521851.614531:0:7631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788521851.614539:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000a00/0x1b7b50db5927cc23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d21 expref: 4 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521851.614562:0:7631:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff996f87cae800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788521851.614582:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521851.614585:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521851.614586:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788521851.614675:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521851.647991:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521851.648118:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799132288 00000100:00100000:2.0:1788521851.648132:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799132288 00000100:00100000:2.0:1788521851.648224:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 295 00000100:00100000:2.0:1788521851.648237:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f865ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+7:2360:x1875400799132288:12345-192.168.206.48@tcp:251:umount.0 00000020:00000080:2.0:1788521851.648305:0:5826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927bbec 00000020:00010000:2.0:1788521851.648316:0:5826:0:(genops.c:1921:obd_stale_export_put()) Put export ffff996fbfc54000: total 0 00000100:00080000:2.0:1788521851.648322:0:5826:0:(import.c:65:import_set_state_nolock()) ffff996fbfc53000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788521851.648427:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f865ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8401310-f5ba-4cf2-b118-0866831b1010+3:2360:x1875400799132288:12345-192.168.206.48@tcp:251:umount.0 Request processed in 192us (449us total) trans 0 rc 0/0 00000020:00010000:1.0:1788521851.648435:0:5821:0:(genops.c:1907:obd_stale_export_get()) Get export ffff996fbfc54000: total 0 00000100:00100000:2.0:1788521851.648437:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 295 00010000:00010000:1.0:1788521851.648503:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff996fbfc54000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788521851.648551:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8392d200/0x1b7b50db5927bc40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd008b3 expref: 2 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521851.648571:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff996fbfc54000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788521851.648596:0:5821:0:(genops.c:885:class_export_put()) final put ffff996fbfc54000/b8401310-f5ba-4cf2-b118-0866831b1010 00010000:00010000:1.0:1788521851.648628:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521851.648630:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521851.648633:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788521851.648693:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff996fbfc54000/b8401310-f5ba-4cf2-b118-0866831b1010 for MGS 00000020:00000080:2.0:1788521851.648735:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff996fbfc53000 for MGS 00000001:00080000:0.0:1788521851.865274:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:0.0:1788521851.865315:0:5856:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4bd13e8f-aac9-42ad-8625-a542705d6920 00000001:00080000:0.0:1788521851.865329:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1788521851.865337:0:5856:0:(genops.c:885:class_export_put()) final put ffff996fb47c9000/4bd13e8f-aac9-42ad-8625-a542705d6920 00000001:00100000:0.0:1788521851.865357:0:5856:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4e406c42-03a1-40c3-937c-c3b114a3dde8 00000001:00080000:0.0:1788521851.865368:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1788521851.865370:0:5856:0:(genops.c:885:class_export_put()) final put ffff996f87cae800/4e406c42-03a1-40c3-937c-c3b114a3dde8 00000020:00000080:0.0:1788521851.865389:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff996fb47c9000/4bd13e8f-aac9-42ad-8625-a542705d6920 for lustre-MDT0000 00000020:00000080:0.0:1788521851.865456:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff996f87cae800/4e406c42-03a1-40c3-937c-c3b114a3dde8 for lustre-MDT0000 00000020:00000080:0.0:1788521851.865487:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff996fb47cc000 for lustre-MDT0000 00000020:00000080:0.0:1788521851.865494:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff996f87cad000 for lustre-MDT0000 00000001:00100000:3.0:1788521851.871903:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4bd13e8f-aac9-42ad-8625-a542705d6920 00000020:00000080:3.0:1788521851.871916:0:6713:0:(genops.c:885:class_export_put()) final put ffff996fb46eb000/4bd13e8f-aac9-42ad-8625-a542705d6920 00000020:00000080:0.0:1788521851.871997:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff996fb46eb000/4bd13e8f-aac9-42ad-8625-a542705d6920 for lustre-OST0000 00000020:00000080:0.0:1788521851.872062:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff996fb46ed000 for lustre-OST0000 00010000:00010000:2.0:1788521852.049934:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521852.238533:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816934400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521852.238626:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521852.239919:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816934400 00000100:00100000:1.0:1788521852.239931:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816934400 00000100:00080000:0.0:1788521852.240032:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521852.240289:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788521852.240311:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816934400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788521852.240350:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521852.240426:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816934400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (1799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521852.240446:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788521852.240520:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816934400:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788521853.070549:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788521853.449025:0:13019:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788521853.471008:0:13019:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788521853.471054:0:13019:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392cc00/0x1b7b50db5927bc7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bc86 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521853.471070:0:13019:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392cc00/0x1b7b50db5927bc7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bc86 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521853.471077:0:13019:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392cc00/0x1b7b50db5927bc7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b7b50db5927bc86 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521853.471085:0:13019:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff996f8392cc00/0x1b7b50db5927bc7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b7b50db5927bc86 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521853.471109:0:13019:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788521853.471127:0:13019:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1788521853.471251:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521853.471258:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f8392cc00/0x1b7b50db5927bc7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b7b50db5927bc86 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521853.471266:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392cc00 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:1.0:1788521853.471270:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f8392cc00/0x1b7b50db5927bc7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b7b50db5927bc86 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521853.471278:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f8392cc00/0x1b7b50db5927bc7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b7b50db5927bc86 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521853.471296:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f8392cc00/0x1b7b50db5927bc7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b7b50db5927bc86 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521853.471302:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788521853.471305:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788521853.471307:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:3.0:1788521853.471417:0:13019:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788521853.471422:0:13019:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788521853.471427:0:13019:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788521853.471450:0:13019:0:(import.c:65:import_set_state_nolock()) ffff996f9816f800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788521853.471509:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f8392cc00/0x1b7b50db5927bc7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b7b50db5927bc86 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521853.471516:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788521853.471539:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f8392cc00/0x1b7b50db5927bc7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b7b50db5927bc86 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521853.471546:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f8392cc00/0x1b7b50db5927bc7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b7b50db5927bc86 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521853.471558:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521853.471567:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521853.471568:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521853.471576:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788521853.471593:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3305:1875400816934656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788521853.471652:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521853.471744:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400816934528:0@lo:39:umount.0 00000100:00100000:0.0:1788521853.471776:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521853.471814:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816934656 00000100:00100000:0.0:1788521853.471820:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816934656 00000100:00100000:0.0:1788521853.471864:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788521853.471872:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f856e6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3305:x1875400816934656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521853.471988:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521853.472002:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f829d5400/0x1b7b50db5927bc86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b7b50db5927bc7f expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521853.472015:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521853.472517:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f856e6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:3305:x1875400816934656:12345-0@lo:103:ldlm_bl.0 Request processed in 644us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521853.472526:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788521853.472631:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816934528 00000100:00100000:1.0:1788521853.472636:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816934528 00000100:00100000:1.0:1788521853.472675:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788521853.472682:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400816934528:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788521853.472702:0:5834:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927ba09 00000100:00080000:1.0:1788521853.472711:0:5834:0:(import.c:65:import_set_state_nolock()) ffff996fac9dc000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788521853.472766:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3303:x1875400816934528:12345-0@lo:39:umount.0 Request processed in 84us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521853.472772:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1788521853.472778:0:5834:0:(genops.c:885:class_export_put()) final put ffff996fac9de800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1788521853.472825:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788521853.472836:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff996fac9de800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788521853.472890:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff996fac9dc000 for lustre-MDT0000 00000100:00080000:0.0:1788521853.474067:0:3303:0:(import.c:65:import_set_state_nolock()) ffff996f9816f800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788521853.474087:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400816934528:0@lo:39:umount.0 00000100:00080000:2.0:1788521853.475836:0:13019:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788521853.475841:0:13019:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788521853.475847:0:13019:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1788521853.476435:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3305:1875400816934656:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788521853.477516:0:13019:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927bc8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bc94 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521853.477532:0:13019:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927bc8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bc94 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521853.477540:0:13019:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927bc8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b7b50db5927bc94 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521853.477548:0:13019:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927bc8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b7b50db5927bc94 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521853.477571:0:13019:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521853.477578:0:13019:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f80030000/0x1b7b50db5927bba6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bbad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521853.477591:0:13019:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f80030000/0x1b7b50db5927bba6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bbad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521853.477597:0:13019:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f80030000/0x1b7b50db5927bba6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b7b50db5927bbad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521853.477620:0:13019:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff996f80030000/0x1b7b50db5927bba6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b7b50db5927bbad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521853.477636:0:13019:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788521853.477643:0:13019:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490ba00/0x1b7b50db5927be9a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bea1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521853.477649:0:13019:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490ba00/0x1b7b50db5927be9a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bea1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521853.477656:0:13019:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490ba00/0x1b7b50db5927be9a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b7b50db5927bea1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521853.477662:0:13019:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff996fb490ba00/0x1b7b50db5927be9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b7b50db5927bea1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521853.477678:0:13019:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788521853.477690:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788521853.477696:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927bc8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b7b50db5927bc94 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521853.477704:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d5600 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:2.0:1788521853.477708:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927bc8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b7b50db5927bc94 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521853.477717:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927bc8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b7b50db5927bc94 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521853.477724:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927bc8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b7b50db5927bc94 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521853.477737:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788521853.477740:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788521853.477770:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927bc8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b7b50db5927bc94 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521853.477776:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521853.477792:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927bc8d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b7b50db5927bc94 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521853.477799:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f829d5600/0x1b7b50db5927bc8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b7b50db5927bc94 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521853.477812:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788521853.477815:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f80030000/0x1b7b50db5927bba6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b7b50db5927bbad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521853.477820:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80030000 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:2.0:1788521853.477822:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f80030000/0x1b7b50db5927bba6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b7b50db5927bbad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521853.477829:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f80030000/0x1b7b50db5927bba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b7b50db5927bbad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521853.477835:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f80030000/0x1b7b50db5927bba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b7b50db5927bbad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521853.477840:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788521853.477842:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788521853.477844:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788521853.477862:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f80030000/0x1b7b50db5927bba6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b7b50db5927bbad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521853.477868:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788521853.477962:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788521853.477980:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816934784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521853.478037:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521853.478086:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816934784 00000100:00100000:3.0:1788521853.478092:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816934784 00000100:00100000:3.0:1788521853.478131:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788521853.478140:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:3304:x1875400816934784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788521853.478180:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521853.478195:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996fb490be00/0x1b7b50db5927bc94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b7b50db5927bc8d expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521853.478207:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521853.478239:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:3304:x1875400816934784:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521853.478245:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788521853.478280:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816934784:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788521853.478312:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521853.478326:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996fb490ba00/0x1b7b50db5927be9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b7b50db5927bea1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521853.478333:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490ba00 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:3.0:1788521853.478343:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996fb490ba00/0x1b7b50db5927be9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b7b50db5927bea1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521853.478350:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996fb490ba00/0x1b7b50db5927be9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b7b50db5927bea1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521853.478356:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996fb490ba00/0x1b7b50db5927be9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b7b50db5927bea1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521853.478362:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788521853.478364:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788521853.478366:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788521853.478382:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996fb490ba00/0x1b7b50db5927be9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b7b50db5927bea1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521853.478388:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788521853.478448:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521853.478675:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f80030000/0x1b7b50db5927bba6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b7b50db5927bbad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521853.478684:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f80030000/0x1b7b50db5927bba6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b7b50db5927bbad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521853.478699:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521853.478701:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521853.478703:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521853.478715:0:13019:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f80031c00/0x1b7b50db5927b95a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927b961 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521853.478723:0:13019:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f80031c00/0x1b7b50db5927b95a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927b961 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521853.478730:0:13019:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f80031c00/0x1b7b50db5927b95a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b7b50db5927b961 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521853.478736:0:13019:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff996f80031c00/0x1b7b50db5927b95a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b7b50db5927b961 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521853.478756:0:13019:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788521853.478759:0:13019:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788521853.478762:0:13019:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788521853.478787:0:13019:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788521853.478791:0:13019:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788521853.478795:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788521853.478801:0:13019:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788521853.478813:0:13019:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff996fad74c800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788521853.478818:0:13019:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff996f91903000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788521853.478822:0:13019:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff996f8606cd40) has exports, disconnecting them 00000020:00080000:2.0:1788521853.478826:0:13019:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff996fad74c800), last request at 1788521850 00000020:00000080:2.0:1788521853.478831:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927bb6e 00000100:00080000:2.0:1788521853.478847:0:13019:0:(import.c:65:import_set_state_nolock()) ffff996fbc6b4000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788521853.478891:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521853.478896:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f80031c00/0x1b7b50db5927b95a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b7b50db5927b961 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521853.478902:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80031c00 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:2.0:1788521853.478905:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f80031c00/0x1b7b50db5927b95a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b7b50db5927b961 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521853.478912:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f80031c00/0x1b7b50db5927b95a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b7b50db5927b961 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521853.478919:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f80031c00/0x1b7b50db5927b95a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b7b50db5927b961 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521853.478924:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788521853.478927:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788521853.478928:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788521853.478943:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f80031c00/0x1b7b50db5927b95a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b7b50db5927b961 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521853.478949:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521853.478960:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f80031c00/0x1b7b50db5927b95a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b7b50db5927b961 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521853.478977:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f80031c00/0x1b7b50db5927b95a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b7b50db5927b961 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521853.478989:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521853.478991:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521853.478993:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788521853.479007:0:13019:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff996fad74c800): rc 0 00000020:00000080:2.0:1788521853.479009:0:13019:0:(genops.c:885:class_export_put()) final put ffff996fad74c800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788521853.479018:0:13019:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff996f91903000), last request at 1788521850 00000020:00000080:2.0:1788521853.479021:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927baa3 00000100:00080000:2.0:1788521853.479027:0:13019:0:(import.c:65:import_set_state_nolock()) ffff996fae01d000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788521853.479037:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788521853.479042:0:13019:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff996f91903000): rc 0 00000020:00000080:2.0:1788521853.479044:0:13019:0:(genops.c:885:class_export_put()) final put ffff996f91903000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1788521853.479051:0:13019:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffac0d0152bae0 00000100:00080000:2.0:1788521853.479070:0:13019:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788521853.479074:0:13019:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1788521853.479085:0:13019:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788521853.479177:0:13019:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788521853.479189:0:13019:0:(import.c:65:import_set_state_nolock()) ffff996fb5501800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788521853.479202:0:13019:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788521853.479204:0:13019:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1788521853.479213:0:13019:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788521853.479276:0:13019:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788521853.479285:0:13019:0:(import.c:65:import_set_state_nolock()) ffff996f913e1800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788521853.479488:0:13019:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff996f8606cd40) has no exports 00000100:00100000:2.0:1788521853.479526:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816935040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788521853.479575:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521853.479609:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788521853.479615:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816934912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788521853.479633:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521853.479652:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788521853.479658:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3305:1875400816935168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788521853.479679:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788521853.480727:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788521853.480740:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff996fad74c800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788521853.480795:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff996f91903000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788521853.480819:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff996fbc6b4000 for lustre-MDT0000 00000020:00000080:1.0:1788521853.480824:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff996fae01d000 for lustre-MDT0000 00000100:00100000:1.0:1788521853.480912:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816935040 00000100:00100000:1.0:1788521853.480919:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816935040 00000100:00100000:1.0:1788521853.480966:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816934912 00000100:00100000:1.0:1788521853.480968:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816934912 00000100:00100000:1.0:1788521853.480984:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816935168 00000100:00100000:1.0:1788521853.480986:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816935168 00000100:00100000:1.0:1788521853.481002:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788521853.481009:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad6fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+19:3307:x1875400816935040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788521853.481036:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521853.481053:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996fb490a000/0x1b7b50db5927bea1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b7b50db5927be9a expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521853.481065:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521853.481111:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad6fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+18:3307:x1875400816935040:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (1534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521853.481118:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788521853.481133:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788521853.481139:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad6fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+17:3307:x1875400816934912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788521853.481276:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521853.481285:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f829d5c00/0x1b7b50db5927bbad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b7b50db5927bba6 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521853.481306:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521853.481397:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad6fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+16:3307:x1875400816934912:12345-0@lo:103:ldlm_bl.0 Request processed in 258us (1762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521853.481404:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788521853.481417:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788521853.481423:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad6fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+15:3305:x1875400816935168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788521853.481430:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521853.481437:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8149ca00/0x1b7b50db5927b961 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b7b50db5927b95a expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521853.481448:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521853.481474:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad6fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0+14:3305:x1875400816935168:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (1795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521853.481490:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788521853.481524:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816934912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788521853.481532:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3307:1875400816935040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788521853.481559:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3305:1875400816935168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521853.482024:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875400816935296:0@lo:9:umount.0 00000100:00100000:0.0:1788521853.482060:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521853.482090:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875400816935424:0@lo:9:umount.0 00000100:00100000:0.0:1788521853.482112:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521853.482248:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816935296 00000100:00100000:1.0:1788521853.482253:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816935296 00000100:00100000:1.0:1788521853.482282:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816935424 00000100:00100000:1.0:1788521853.482284:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816935424 00000100:00100000:1.0:1788521853.482399:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788521853.482408:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400816935296:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788521853.482427:0:6690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927baf0 00000100:00080000:1.0:1788521853.482434:0:6690:0:(import.c:65:import_set_state_nolock()) ffff996f913e2800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788521853.482464:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00080000:0.0:1788521853.482765:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788521853.482785:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521853.483133:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3303:x1875400816935296:12345-0@lo:9:umount.0 Request processed in 726us (1071us total) trans 0 rc 0/0 00000100:00080000:0.0:1788521853.483830:0:3303:0:(import.c:65:import_set_state_nolock()) ffff996fb5501800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788521853.483845:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788521853.483847:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788521853.483851:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875400816935296:0@lo:9:umount.0 00000100:00100000:1.0:1788521853.484025:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788521853.484050:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788521853.484059:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400816935424:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788521853.484077:0:6690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927bbd7 00000100:00080000:1.0:1788521853.484084:0:6690:0:(import.c:65:import_set_state_nolock()) ffff996fbfc66000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788521853.484122:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:3.0:1788521853.484300:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996fb490ba00/0x1b7b50db5927be9a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b7b50db5927bea1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521853.484311:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996fb490ba00/0x1b7b50db5927be9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b7b50db5927bea1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521853.484471:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521853.484555:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521853.484558:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521853.484560:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521853.484936:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3303:x1875400816935424:12345-0@lo:9:umount.0 Request processed in 879us (2822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521853.484944:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788521853.485006:0:3303:0:(import.c:65:import_set_state_nolock()) ffff996f913e1800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788521853.485024:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788521853.485026:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788521853.485030:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875400816935424:0@lo:9:umount.0 00000020:00080000:2.0:1788521853.503853:0:13019:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff996f8606cd40) has no exports 00000020:00000080:2.0:1788521853.582449:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927b9b5 00000020:00000080:2.0:1788521853.582465:0:13019:0:(genops.c:885:class_export_put()) final put ffff996f91907000/lustre-QMT0000_UUID 00000020:01000000:2.0:1788521853.582481:0:13019:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788521853.582655:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff996f91907000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788521853.582767:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788521853.582777:0:13019:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788521853.582782:0:13019:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff996fae063380) has no exports 00000020:00000080:0.0:1788521853.583067:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927b9ae 00000020:00000080:0.0:1788521853.583073:0:13019:0:(genops.c:885:class_export_put()) final put ffff996fb5503800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788521853.583115:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788521853.583121:0:13019:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788521853.583124:0:13019:0:(genops.c:885:class_export_put()) final put ffff996fae06f800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788521853.583126:0:13019:0:(genops.c:844:class_export_destroy()) destroying export ffff996fae06f800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788521853.583130:0:13019:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788521853.583853:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff996fb5503800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788521853.583934:0:13019:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff996fb4497600 - data ffff996fbfed6870/ffff996fbfc68400 00000020:01000000:0.0:1788521853.584065:0:13019:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff996f9ec47420 - data ffff996f820d7288/ffff996fb5380c00 00000001:00000004:0.0:1788521853.599107:0:13019:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:1.0:1788521853.716597:0:13019:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788521853.716606:0:13019:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:1.0:1788521853.716627:0:13019:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788521853.716630:0:13019:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788521853.717011:0:6739:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788521853.717015:0:6739:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1788521853.717044:0:6739:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788521853.718841:0:13019:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788521853.718846:0:13019:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:1.0:1788521853.718857:0:13019:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788521853.718859:0:13019:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788521853.719045:0:8155:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788521853.719053:0:8155:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1788521853.719068:0:8155:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788521853.790927:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927b97d 00000020:00000080:1.0:1788521853.790938:0:13019:0:(genops.c:885:class_export_put()) final put ffff996fb3f9e800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788521853.791939:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927b992 00000020:00000080:1.0:1788521853.791947:0:13019:0:(genops.c:885:class_export_put()) final put ffff996fae06c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788521853.791956:0:13019:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788521853.791961:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788521853.791968:0:13019:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788521853.791972:0:13019:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff996f860699c0) has no exports 00000004:01000000:1.0:1788521853.792113:0:13019:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788521853.792120:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927bbd0 00000020:00000080:1.0:1788521853.792123:0:13019:0:(genops.c:885:class_export_put()) final put ffff996fb47ca000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788521853.792127:0:13019:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788521853.792130:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788521853.792135:0:13019:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788521853.792138:0:13019:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff996f90f1cd40) has no exports 00000020:00000080:1.0:1788521853.792164:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927bbc9 00000020:00000080:1.0:1788521853.792168:0:13019:0:(genops.c:885:class_export_put()) final put ffff996fb7b19800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788521853.792505:0:13019:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788521853.792509:0:13019:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788521853.792515:0:13019:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1788521853.792519:0:13019:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788521853.792529:0:13019:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788521853.792556:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788521853.792562:0:13019:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788521853.792570:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927bae9 00000020:00000080:1.0:1788521853.792574:0:13019:0:(genops.c:885:class_export_put()) final put ffff996f913e6000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788521853.792577:0:13019:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788521853.792580:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788521853.792583:0:13019:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788521853.792585:0:13019:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff996fae0619c0) has no exports 00000020:00000080:1.0:1788521853.792589:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927bae2 00000020:00000080:1.0:1788521853.792591:0:13019:0:(genops.c:885:class_export_put()) final put ffff996fb5504000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788521853.792877:0:13019:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788521853.792880:0:13019:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788521853.792882:0:13019:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1788521853.792886:0:13019:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788521853.792887:0:13019:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788521853.792909:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788521853.792913:0:13019:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788521853.792938:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788521853.792941:0:13019:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788521853.792964:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927b999 00000020:00000080:1.0:1788521853.792968:0:13019:0:(genops.c:885:class_export_put()) final put ffff996fae068000/lustre-MDD0000_UUID 00000020:01000000:1.0:1788521853.792971:0:13019:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788521853.792974:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788521853.792976:0:13019:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788521853.792978:0:13019:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff996fae064d40) has no exports 00000020:00000080:1.0:1788521853.792999:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788521853.793001:0:13019:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788521853.793003:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927b9a0 00000020:00000080:1.0:1788521853.793006:0:13019:0:(genops.c:885:class_export_put()) final put ffff996fae069000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788521853.793011:0:13019:0:(tgt_mount.c:187:server_put_mount()) put mount ffff996f85616000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788521853.793014:0:13019:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996f85616000 3 00000020:01000004:1.0:1788521853.793017:0:13019:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff996f85616000 from lustre-MDT0000 00000020:00000080:1.0:1788521853.793039:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788521853.793042:0:13019:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788521853.793044:0:13019:0:(genops.c:885:class_export_put()) final put ffff996fb3f98800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788521853.793047:0:13019:0:(genops.c:844:class_export_destroy()) destroying export ffff996fb3f98800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788521853.793054:0:13019:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788521853.793107:0:13019:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788521853.793110:0:13019:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788521853.793113:0:13019:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788521853.793115:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788521853.793118:0:13019:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788521853.793124:0:13019:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff996f86064000 672d8d4a-a4f6-4b8b-95c4-7d19376ccba0 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788521853.793129:0:13019:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff996f90f18000) has exports, disconnecting them 00000020:00080000:1.0:1788521853.793133:0:13019:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff996f86064000), last request at 1788521644 00000020:00000080:1.0:1788521853.793168:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927b93e 00000020:00010000:1.0:1788521853.793172:0:13019:0:(genops.c:1921:obd_stale_export_put()) Put export ffff996f86064000: total 8 00000100:00080000:1.0:1788521853.793176:0:13019:0:(import.c:65:import_set_state_nolock()) ffff996f86061800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788521853.793193:0:13019:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff996f86064000): rc 0 00000020:00080000:1.0:1788521853.793197:0:13019:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff996f90f18000) has no exports 00000100:00100000:1.0:1788521853.793248:0:5827:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff996f857e2000:5827] 1 exiting: rc = 0 00000100:00100000:1.0:1788521853.793329:0:5828:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff996f8659e600:5828] 2 exiting: rc = 0 00000020:00000080:2.0:1788521853.793459:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff996fb3f9e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788521853.793471:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff996fae06c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1788521853.793475:0:8:0:(genops.c:885:class_export_put()) final put ffff996fb3f9c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788521853.793477:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff996fb3f9c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788521853.793480:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788521853.793577:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff996fb47ca000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788521853.793582:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff996fb7b19800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788521853.793586:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff996f913e1800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788521853.793591:0:8:0:(genops.c:885:class_export_put()) final put ffff996fb47c1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788521853.793593:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff996fb47c1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788521853.793603:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00010000:3.0:1788521853.793615:0:5822:0:(genops.c:1907:obd_stale_export_get()) Get export ffff996f86064000: total 4 00000020:00000080:2.0:1788521853.793635:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff996f913e6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788521853.793642:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff996fb5504000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788521853.793655:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff996fb5501800 for lustre-OST0000-osc-MDT0000 00010000:00010000:3.0:1788521853.793659:0:5822:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff996f86064000, canceled 0 locks, left on hash table 8. 00000020:00000080:2.0:1788521853.793660:0:8:0:(genops.c:885:class_export_put()) final put ffff996f913e7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788521853.793665:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff996f913e7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788521853.793668:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00010000:00010000:3.0:1788521853.793689:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8392c600/0x1b7b50db5927bc4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b7b50db5927bc47 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521853.793708:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8392d600/0x1b7b50db5927bc5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b7b50db5927bc55 expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788521853.793731:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff996fae068000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788521853.793737:0:8:0:(genops.c:885:class_export_put()) final put ffff996fb3f98000/lustre-MDD0000_UUID 00010000:00010000:3.0:1788521853.793738:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f80030a00/0x1b7b50db5927bc6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b7b50db5927bc63 expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788521853.793742:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff996fb3f98000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788521853.793749:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00010000:00010000:3.0:1788521853.793770:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f829d4200/0x1b7b50db5927bc78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b7b50db5927bc71 expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521853.793785:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8392d000/0x1b7b50db5927be85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b7b50db5927be7e expref: 5 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521853.793796:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996fc217c400/0x1b7b50db5927be93 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b7b50db5927be8c expref: 4 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521853.793813:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996fb490a600/0x1b7b50db5927bca2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b7b50db5927bc9b expref: 3 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521853.793828:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f80030200/0x1b7b50db5927ba56 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b7b50db5927ba4f expref: 2 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521853.793845:0:5822:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff996f86064000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1788521853.793864:0:5822:0:(genops.c:885:class_export_put()) final put ffff996f86064000/672d8d4a-a4f6-4b8b-95c4-7d19376ccba0 00010000:00010000:3.0:1788521853.793880:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521853.793883:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521853.793886:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788521853.793911:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff996fae069000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788521853.793916:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff996f86064000/672d8d4a-a4f6-4b8b-95c4-7d19376ccba0 for MGS 00000020:00000080:2.0:1788521853.793930:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff996f86061800 for MGS 00000100:00100000:2.0:1788521853.793952:0:5826:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff996f8659ec00:5826] 0 exiting: rc = 1 00000100:00100000:3.0:1788521853.794084:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794093:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794101:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794107:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794115:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794122:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794130:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794158:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794166:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794174:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794182:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794190:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794198:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794208:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794216:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794221:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794237:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794244:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794251:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794257:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794266:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794273:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794280:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794299:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794307:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794376:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794387:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794397:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794403:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794409:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794415:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794420:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794424:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794430:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794435:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794440:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794445:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794450:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794455:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794461:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794466:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794471:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794483:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794489:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794495:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794500:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794658:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794669:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794676:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794684:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794691:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794698:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794705:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794713:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794721:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794729:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794737:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794745:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794766:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794774:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794782:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794789:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794796:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.794804:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1788521853.795332:0:13019:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788521853.795336:0:13019:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1788521853.795905:0:13019:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff996fb7880b40 - data ffff996fb3222bd0/ffff996fb4a8f400 00000020:01000000:2.0:1788521853.796028:0:13019:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff996f86a59600 - data ffff996f821525e8/ffff996f86016400 00000020:00000080:2.0:1788521853.796502:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927b922 00000020:00000080:2.0:1788521853.796509:0:13019:0:(genops.c:885:class_export_put()) final put ffff996f9198b800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788521853.796522:0:13019:0:(tgt_mount.c:187:server_put_mount()) put mount ffff996f85616000 from MGS, refs=2 00000020:01000004:2.0:1788521853.796525:0:13019:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996f85616000 2 00000020:01000004:2.0:1788521853.796528:0:13019:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff996f85616000 from MGS 00000020:00000080:2.0:1788521853.796547:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788521853.796552:0:13019:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788521853.796554:0:13019:0:(genops.c:885:class_export_put()) final put ffff996f9198d000/MGS 00000020:00000080:2.0:1788521853.796556:0:13019:0:(genops.c:844:class_export_destroy()) destroying export ffff996f9198d000/MGS for MGS 00000020:01000000:2.0:1788521853.796561:0:13019:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788521853.796616:0:13019:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788521853.796619:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788521853.796624:0:13019:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788521853.796630:0:13019:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff996fb3f56000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788521853.796635:0:13019:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff996fb47dcd40) has exports, disconnecting them 00000020:00080000:2.0:1788521853.796639:0:13019:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff996fb3f56000), last request at 1788521644 00000020:00000080:2.0:1788521853.796643:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927b9ed 00000020:00080000:2.0:1788521853.796651:0:13019:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff996fb3f56000): rc 0 00000020:00000080:2.0:1788521853.796655:0:13019:0:(genops.c:885:class_export_put()) final put ffff996fb3f56000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788521853.797300:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff996f9198b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788521853.797308:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff996fb3f56000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788521853.798191:0:13019:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788521853.798196:0:13019:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788521853.798201:0:13019:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788521853.798207:0:13019:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788521853.798274:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff996f9816f800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788521853.798727:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788521853.798735:0:13019:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788521853.798740:0:13019:0:(genops.c:885:class_export_put()) final put ffff996fac974000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788521853.798743:0:13019:0:(genops.c:844:class_export_destroy()) destroying export ffff996fac974000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788521853.798752:0:13019:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788521853.798821:0:13019:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996f85616000 1 00000020:00000080:3.0:1788521853.798826:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927b914 00000020:00000080:3.0:1788521853.798840:0:13019:0:(genops.c:885:class_export_put()) final put ffff996f9198b000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788521853.798847:0:13019:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788521853.798850:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788521853.798854:0:13019:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788521853.798858:0:13019:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff996f90f1b380) has no exports 00000020:00000080:1.0:1788521853.798863:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff996f9198b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788521853.835901:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788521853.835915:0:13019:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788521853.835920:0:13019:0:(genops.c:885:class_export_put()) final put ffff996f91989000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788521853.835925:0:13019:0:(genops.c:844:class_export_destroy()) destroying export ffff996f91989000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788521853.835931:0:13019:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788521853.836056:0:13019:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff996f85615000 00000020:01000000:0.0:1788521853.836079:0:13019:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788521853.836084:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788521853.836088:0:13019:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788521853.836092:0:13019:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff996f86068000) has no exports 00000100:00100000:0.0:1788521853.836210:0:5833:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff996f86058400:5833] 0 exiting: rc = 1 00000100:00100000:3.0:1788521853.836304:0:10083:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff996fbc54c000:10083] 3 exiting: rc = 0 00000100:00100000:1.0:1788521853.836374:0:5835:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff996f86059200:5835] 2 exiting: rc = 0 00000100:00100000:1.0:1788521853.836440:0:5834:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff996fa2320600:5834] 1 exiting: rc = 0 00000100:00100000:0.0:1788521853.836531:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836539:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836544:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836550:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836555:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836571:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836577:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836582:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836587:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836591:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836597:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836602:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836606:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836612:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836617:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836623:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836628:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836633:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836638:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836643:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836647:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836652:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836657:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836662:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836667:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836671:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836678:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836683:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836689:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836694:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836699:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836705:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836711:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836716:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836721:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836727:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836733:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836738:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836743:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836748:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836760:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836766:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836771:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836776:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836781:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836786:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836803:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836810:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836815:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836820:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836825:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836831:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836836:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836841:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836846:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836852:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836858:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836863:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836868:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836873:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836877:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836882:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836888:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.836894:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521853.847006:0:5836:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff996f86058c00:5836] 0 exiting: rc = 1 00000100:00100000:3.0:1788521853.847371:0:5837:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff996f86058800:5837] 1 exiting: rc = 0 00000100:00100000:0.0:1788521853.847472:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847481:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847487:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847493:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847498:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847504:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847510:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847515:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847521:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847796:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847803:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847821:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847828:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847834:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847839:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847844:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847850:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847855:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847861:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847866:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847871:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847876:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847882:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847888:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847893:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847898:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847904:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847909:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847914:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847919:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847925:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847930:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847936:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847941:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847947:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847952:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847957:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847962:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847967:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847971:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847977:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847982:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847987:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847993:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.847998:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.848002:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.848012:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.848017:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.848023:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.848028:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.848033:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.848039:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.848044:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.848049:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.848055:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.848060:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.848065:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.848070:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.848400:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.848410:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.848415:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.848420:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.848425:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.848430:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.848966:0:11961:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff996fb458b600:11961] 2 exiting: rc = 0 00000100:00100000:2.0:1788521853.849081:0:5838:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff996f85724600:5838] 0 exiting: rc = 1 00000100:00100000:3.0:1788521853.849182:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff996f98836c00:5839] 1 exiting: rc = 0 00000100:00100000:0.0:1788521853.849303:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849311:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849317:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849323:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849328:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849334:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849340:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849345:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849351:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849357:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849362:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849369:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849374:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849380:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849399:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849405:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849418:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849424:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849431:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849437:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849442:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849447:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849454:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849460:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849467:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849474:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849498:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849505:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849511:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849521:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849542:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849548:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849553:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849561:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849567:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849572:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849577:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849598:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849625:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849632:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849641:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849647:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849652:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849658:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849665:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849672:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849678:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849684:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849689:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849695:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849770:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849781:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849787:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849793:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849799:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849814:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849820:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849826:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849833:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849839:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849845:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849852:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849857:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.849870:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521853.858328:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff996f85725c00:5841] 1 exiting: rc = 0 00000100:00100000:2.0:1788521853.858517:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff996f85725e00:5840] 0 exiting: rc = 1 00000100:00100000:1.0:1788521853.858748:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858757:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858762:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858767:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858785:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858790:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858796:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858801:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858805:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858811:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858816:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858821:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858826:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858832:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858838:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858843:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858847:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858853:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858858:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858863:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858868:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858873:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858877:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858883:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858888:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858894:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858899:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858904:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858909:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858914:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858919:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858925:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858930:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858935:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858940:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858945:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.858950:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.859178:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.859183:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.859194:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.859199:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.859205:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.859210:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.859215:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.859221:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.859226:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.859231:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.859237:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.859241:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.859247:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.859252:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.859257:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.859262:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.859267:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.859272:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.859277:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.859282:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.859297:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.859303:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.859308:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.859312:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.859318:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.859323:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.859328:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.859798:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff996f85724000:5843] 1 exiting: rc = 0 00000100:00100000:0.0:1788521853.860051:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff996f85724400:5842] 0 exiting: rc = 1 00000100:00100000:1.0:1788521853.860171:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860177:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860183:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860188:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860192:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860198:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860203:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860208:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860214:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860219:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860231:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860236:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860242:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860246:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860252:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860257:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860261:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860267:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860272:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860277:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860282:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860304:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860309:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860314:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860319:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860324:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860329:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860335:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860339:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860344:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860349:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860354:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860359:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860364:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860369:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860374:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860379:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860383:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860389:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860394:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860399:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860404:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860409:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860414:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860419:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860430:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860435:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860440:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860445:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860450:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860455:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860460:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860465:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860478:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860483:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860488:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860494:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860499:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860504:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860509:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860513:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860519:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860524:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860528:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.860846:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff996f85724c00:5844] 0 exiting: rc = 1 00000100:00100000:2.0:1788521853.861186:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff996f85721a00:5845] 1 exiting: rc = 0 00000100:00100000:1.0:1788521853.861296:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861303:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861309:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861314:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861319:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861325:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861330:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861335:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861340:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861346:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861352:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861357:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861362:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861367:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861372:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861392:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861397:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861403:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861408:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861413:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861418:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861423:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861428:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861434:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861439:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861444:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861449:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861455:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861459:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861465:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861470:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861475:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861480:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861485:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861490:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861495:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861500:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861510:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861516:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861520:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861525:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861531:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861536:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861541:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861546:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861551:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861556:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861561:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861566:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861572:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861582:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861648:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861654:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861659:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861664:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861670:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861674:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861679:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861684:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861689:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861694:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861699:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861705:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.861710:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521853.862220:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff996f85713600:5847] 1 exiting: rc = 0 00000100:00100000:1.0:1788521853.862416:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff996f85712e00:5848] 2 exiting: rc = 0 00000100:00100000:2.0:1788521853.862769:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff996f8571f800:5846] 0 exiting: rc = 1 00000100:00100000:3.0:1788521853.862850:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.862857:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.862862:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.862867:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.862875:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.862880:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.862887:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.862893:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.862898:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.862904:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.862910:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.862916:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.862921:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.862927:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.862933:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.862938:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.862944:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.862950:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863021:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863027:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863033:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863039:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863044:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863050:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863055:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863128:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863135:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863165:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863192:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863199:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863205:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863210:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863216:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863222:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863228:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863234:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863239:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863244:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863250:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863254:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863260:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863267:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863272:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863277:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863283:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863300:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863305:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863311:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863317:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863322:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863327:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863333:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863352:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863358:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863364:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863370:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863375:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863381:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863386:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863392:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863402:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863408:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863413:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521853.863419:0:13019:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788521853.869356:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788521853.869369:0:13019:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788521853.869375:0:13019:0:(genops.c:885:class_export_put()) final put ffff996f86807800/MDS_uuid 00000020:00000080:2.0:1788521853.869380:0:13019:0:(genops.c:844:class_export_destroy()) destroying export ffff996f86807800/MDS_uuid for MDS 00000020:01000000:2.0:1788521853.869389:0:13019:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788521853.869512:0:13019:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788521854.095265:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521855.129680:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521855.313882:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788521855.313910:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816935552:0@lo:400:kworker.0 00000400:00000100:3.0:1788521855.313974:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875400816935552 offset 0 length 224: 4 00000100:00100000:3.0:1788521855.314040:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875400816935680:0@lo:400:kworker.0 00000400:00000100:3.0:1788521855.314062:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875400816935680 offset 0 length 224: 4 00000100:00100000:3.0:1788521855.314076:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788521855.314081:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875400816935808:0@lo:400:kworker.0 00000400:00000100:3.0:1788521855.314096:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875400816935808 offset 0 length 224: 4 00010000:00010000:3.0:1788521856.148599:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788521856.414985:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788521856.414996:0:7647:0:(genops.c:885:class_export_put()) final put ffff996fbfc67800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788521856.415029:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff996fbfc67800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788521856.415311:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff996fbfc66000 for lustre-OST0001 00000020:01000004:1.0:1788521856.739812:0:13169:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788521856.753423:0:13169:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788521856.753480:0:13169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392d800/0x1b7b50db5927bc63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bc6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521856.753498:0:13169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392d800/0x1b7b50db5927bc63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bc6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521856.753508:0:13169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392d800/0x1b7b50db5927bc63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b7b50db5927bc6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521856.753516:0:13169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff996f8392d800/0x1b7b50db5927bc63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b7b50db5927bc6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521856.753540:0:13169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788521856.753546:0:13169:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788521856.753572:0:13169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788521856.753587:0:13169:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff996f860d8380 x1875400816935680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521871 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521856.753627:0:13169:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788521856.753635:0:13169:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788521856.753664:0:13169:0:(import.c:65:import_set_state_nolock()) ffff996f85cd6000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788521856.754376:0:7631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521856.754388:0:7631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f8392d800/0x1b7b50db5927bc63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b7b50db5927bc6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521856.754398:0:7631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392d800 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:1.0:1788521856.754403:0:7631:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f8392d800/0x1b7b50db5927bc63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b7b50db5927bc6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521856.754414:0:7631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f8392d800/0x1b7b50db5927bc63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b7b50db5927bc6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521856.754422:0:7631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f8392d800/0x1b7b50db5927bc63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b7b50db5927bc6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521856.754428:0:7631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788521856.754443:0:7631:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788521856.754446:0:7631:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788521856.754556:0:7631:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f8392d800/0x1b7b50db5927bc63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b7b50db5927bc6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521856.754564:0:7631:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788521856.754633:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816936064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521856.754718:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788521856.754813:0:7631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f8392d800/0x1b7b50db5927bc63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b7b50db5927bc6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521856.754824:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f8392d800/0x1b7b50db5927bc63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b7b50db5927bc6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521856.754842:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521856.754844:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521856.754846:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521856.754876:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816936064 00000100:00100000:1.0:1788521856.754893:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816936064 00000100:00100000:3.0:1788521856.754930:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875400816935680:0@lo:400:kworker.0 00000100:00100000:1.0:1788521856.754950:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788521856.754959:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3304:x1875400816936064:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788521856.754966:0:5818:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788521856 with bad export cookie 1980265364183300414 00000100:00100000:2.0:1788521856.755635:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f812ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875400816935936:0@lo:39:umount.0 00000400:00000100:2.0:1788521856.755674:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875400816935936 offset 0 length 224: 4 00000100:00100000:0.0:1788521856.785425:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3304:x1875400816936064:12345-0@lo:103:ldlm_bl.0 Request processed in 30459us (30702us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788521856.785439:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788521856.786894:0:3304:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.148@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788521856.786902:0:3304:0:(import.c:65:import_set_state_nolock()) ffff996f86800800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788521856.786907:0:3304:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788521856.798416:0:3304:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.148@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788521856.798424:0:3304:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788521856.798436:0:3304:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff996f860d9180 x1875400816935552/t0(0) o400->MGC192.168.206.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788521871 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521856.798454:0:3304:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff996f85d36680 x1875400816936064/t0(0) o103->MGC192.168.206.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788521872 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788521856.798488:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788521856.798491:0:3304:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788521856.798493:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788521856.798498:0:3304:0:(import.c:65:import_set_state_nolock()) ffff996f86800800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788521856.798504:0:3304:0:(import.c:545:import_select_connection()) MGC192.168.206.148@tcp: connect to NID 0@lo last attempt 144 00000100:00080000:3.0:1788521856.798515:0:3304:0:(import.c:665:import_select_connection()) MGC192.168.206.148@tcp: import ffff996f86800800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1788521856.798617:0:3304:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996fad6fe300 x1875400816936192/t0(0) o250->MGC192.168.206.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788521856.798695:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3303:1875400816936192:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1788521856.798759:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875400816936192 offset 0 length 520: 4 00000100:00100000:2.0:1788521856.798889:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816935552:0@lo:400:kworker.0 00000100:00100000:2.0:1788521856.798926:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3304:1875400816936064:0@lo:103:ldlm_bl.0 00000001:00100000:3.0:1788521856.898064:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788521856.898074:0:6713:0:(genops.c:885:class_export_put()) final put ffff996f913e3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788521856.898172:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff996f913e3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788521856.898238:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff996f913e2800 for lustre-OST0000 00010000:00010000:2.0:1788521857.166453:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521858.190561:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521859.215228:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521860.242080:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788521860.431511:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 672d8d4a-a4f6-4b8b-95c4-7d19376ccba0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788521860.431522:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 672d8d4a-a4f6-4b8b-95c4-7d19376ccba0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788521860.431681:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788521860.431707:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f812e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875400816936320:0@lo:400:kworker.0 00000400:00000100:0.0:1788521860.431779:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875400816936320 offset 0 length 224: 4 00010000:00010000:3.0:1788521861.262472:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788521861.455136:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 672d8d4a-a4f6-4b8b-95c4-7d19376ccba0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788521861.455167:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 672d8d4a-a4f6-4b8b-95c4-7d19376ccba0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788521861.456010:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875400816936448:0@lo:400:kworker.0 00000400:00000100:3.0:1788521861.456078:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875400816936448 offset 0 length 224: 4 00010000:00010000:1.0:1788521862.286565:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521863.311313:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521864.334701:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521865.358472:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521866.062326:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788521856/real 1788521856] req@ffff996fad6fe300 x1875400816936192/t0(0) o250->MGC192.168.206.148@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788521866 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521866.062367:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff996fad6fe300 x1875400816936192/t0(0) o250->MGC192.168.206.148@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788521866 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521866.062380:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788521856/real 1788521856] req@ffff996f812ea300 x1875400816935936/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788521866 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521866.062395:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff996f812ea300 x1875400816935936/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788521866 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788521866.062445:0:3303:0:(import.c:65:import_set_state_nolock()) ffff996f86800800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788521866.062474:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788521866.062479:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3303:1875400816936192:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1788521866.062486:0:3303:0:(import.c:65:import_set_state_nolock()) ffff996f85cd6000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788521866.062508:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f812ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875400816935936:0@lo:39:umount.0 00000100:00080000:1.0:1788521866.062552:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 672d8d4a-a4f6-4b8b-95c4-7d19376ccba0->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788521866.062562:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788521866.062567:0:36:0:(import.c:65:import_set_state_nolock()) ffff996f86800800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788521866.062575:0:36:0:(import.c:545:import_select_connection()) MGC192.168.206.148@tcp: connect to NID 0@lo last attempt 356 00000100:00080000:1.0:1788521866.062597:0:36:0:(import.c:630:import_select_connection()) MGC192.168.206.148@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788521866.062605:0:36:0:(import.c:665:import_select_connection()) MGC192.168.206.148@tcp: import ffff996f86800800 using connection 192.168.206.148@tcp/0@lo 00000100:00080000:2.0:1788521866.062629:0:13169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788521866.062636:0:13169:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788521866.062640:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996f85d35500 x1875400816936576/t0(0) o250->MGC192.168.206.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788521866.062643:0:13169:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1788521866.062756:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875400816936704:0@lo:400:kworker.0 00000400:00000100:3.0:1788521866.062824:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875400816936704 offset 0 length 224: 4 00010000:00010000:2.0:1788521866.063571:0:13169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bc71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bc78 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521866.063585:0:13169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bc71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bc78 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521866.063593:0:13169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bc71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b7b50db5927bc78 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521866.063601:0:13169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bc71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b7b50db5927bc78 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521866.063756:0:13169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521866.063765:0:13169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490b400/0x1b7b50db5927be8c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927be93 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521866.063773:0:13169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490b400/0x1b7b50db5927be8c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927be93 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521866.063779:0:13169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490b400/0x1b7b50db5927be8c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b7b50db5927be93 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521866.063799:0:13169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff996fb490b400/0x1b7b50db5927be8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b7b50db5927be93 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521866.063827:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788521866.063835:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bc71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b7b50db5927bc78 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521866.063842:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80031800 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:1.0:1788521866.063846:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bc71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b7b50db5927bc78 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521866.063855:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bc71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b7b50db5927bc78 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521866.063863:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bc71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b7b50db5927bc78 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521866.063869:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788521866.063872:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00000100:00100000:0.0:1788521866.063877:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3303:1875400816936576:0@lo:250:kworker.0 00010000:00010000:1.0:1788521866.063884:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff996f86800800 00010000:00010000:1.0:1788521866.063890:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bc71 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x1b7b50db5927bc78 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521866.063897:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f80031800/0x1b7b50db5927bc71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x1b7b50db5927bc78 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521866.063912:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521866.063915:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996fb490b400/0x1b7b50db5927be8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b7b50db5927be93 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000400:00000100:0.0:1788521866.063923:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875400816936576 offset 0 length 520: 4 00010000:00010000:1.0:1788521866.063935:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490b400 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:1.0:1788521866.063941:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996fb490b400/0x1b7b50db5927be8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b7b50db5927be93 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521866.063948:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996fb490b400/0x1b7b50db5927be8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b7b50db5927be93 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521866.063956:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996fb490b400/0x1b7b50db5927be8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b7b50db5927be93 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521866.063961:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788521866.063964:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788521866.063971:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff996f86800800 00010000:00010000:1.0:1788521866.063975:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996fb490b400/0x1b7b50db5927be8c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1b7b50db5927be93 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521866.063982:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521866.063984:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521866.063986:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521866.064416:0:13169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788521866.064422:0:13169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996fb490b400/0x1b7b50db5927be8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1b7b50db5927be93 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521866.064433:0:13169:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1788521866.064438:0:13169:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1788521866.064440:0:13169:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788521866.064463:0:13169:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788521866.064467:0:13169:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788521866.064472:0:13169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788521866.064477:0:13169:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788521866.064481:0:13169:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff996fb47db380) has no exports 00000020:00080000:2.0:1788521866.064502:0:13169:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff996fb47db380) has no exports 00010000:00010000:1.0:1788521866.066179:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788521866.066534:0:13169:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff996f87deb300 - data ffff996fb3222798/ffff996fb4a8d400 00000020:01000000:2.0:1788521866.066653:0:13169:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff996fad7cd000 - data ffff996fa801be58/ffff996fb41c0000 00100000:10000000:2.0:1788521866.073342:0:13169:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788521866.093328:0:13169:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927ba72 00000020:00000080:0.0:1788521866.093337:0:13169:0:(genops.c:885:class_export_put()) final put ffff996fb7b1c800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788521866.093353:0:13169:0:(tgt_mount.c:187:server_put_mount()) put mount ffff996f97fff000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788521866.093356:0:13169:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996f97fff000 2 00000020:01000004:0.0:1788521866.093359:0:13169:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff996f97fff000 from lustre-OST0000 00000020:00000080:0.0:1788521866.093379:0:13169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788521866.093388:0:13169:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788521866.093391:0:13169:0:(genops.c:885:class_export_put()) final put ffff996fb7b1a000/lustre-OST0000_UUID 00000020:00000080:0.0:1788521866.093394:0:13169:0:(genops.c:844:class_export_destroy()) destroying export ffff996fb7b1a000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788521866.093401:0:13169:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788521866.093443:0:13169:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788521866.093448:0:13169:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788521866.093451:0:13169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788521866.093456:0:13169:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788521866.093463:0:13169:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff996f913e7800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788521866.093469:0:13169:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff996fae060000) has exports, disconnecting them 00000020:00080000:0.0:1788521866.093474:0:13169:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff996f913e7800), last request at 1788521661 00000020:00000080:0.0:1788521866.093477:0:13169:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927ba9c 00000020:00080000:0.0:1788521866.093487:0:13169:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff996f913e7800): rc 0 00000020:00000080:0.0:1788521866.093503:0:13169:0:(genops.c:885:class_export_put()) final put ffff996f913e7800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788521866.093737:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff996fb7b1c800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788521866.093748:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff996f913e7800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788521866.095216:0:13169:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788521866.095233:0:13169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788521866.095237:0:13169:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788521866.095244:0:13169:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788521866.095277:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff996f85cd6000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788521866.095415:0:13169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788521866.095433:0:13169:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788521866.095437:0:13169:0:(genops.c:885:class_export_put()) final put ffff996fb5505800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788521866.095440:0:13169:0:(genops.c:844:class_export_destroy()) destroying export ffff996fb5505800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788521866.095444:0:13169:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1788521866.095484:0:13169:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996f97fff000 1 00000020:00000080:1.0:1788521866.095489:0:13169:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927ba2c 00000020:00000080:1.0:1788521866.095494:0:13169:0:(genops.c:885:class_export_put()) final put ffff996f85cd1000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788521866.095501:0:13169:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788521866.095509:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff996f85cd1000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788521866.095516:0:13169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788521866.095520:0:13169:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788521866.095523:0:13169:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff996f90f199c0) has no exports 00000020:00000080:1.0:1788521866.111356:0:13169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788521866.111371:0:13169:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788521866.111376:0:13169:0:(genops.c:885:class_export_put()) final put ffff996fae06e800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788521866.111382:0:13169:0:(genops.c:844:class_export_destroy()) destroying export ffff996fae06e800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788521866.111388:0:13169:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788521866.111518:0:13169:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff996fae068800 00000020:02000400:1.0:1788521866.111567:0:13169:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788521866.383319:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521867.407913:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788521868.188597:0:13324:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788521868.201607:0:13324:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788521868.201676:0:13324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f829d4e00/0x1b7b50db5927bc47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bc4e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521868.201690:0:13324:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f829d4e00/0x1b7b50db5927bc47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bc4e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521868.201697:0:13324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f829d4e00/0x1b7b50db5927bc47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b7b50db5927bc4e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521868.201715:0:13324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff996f829d4e00/0x1b7b50db5927bc47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b7b50db5927bc4e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521868.201845:0:13324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788521868.201851:0:13324:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788521868.201887:0:13324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788521868.201897:0:13324:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff996f860d9c00 x1875400816935808/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521871 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521868.201918:0:13324:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff996f812e8000 x1875400816936320/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521876 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521868.201935:0:13324:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff996f85d34700 x1875400816936448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521877 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521868.201943:0:13324:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff996f85d35c00 x1875400816936704/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521882 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521868.201953:0:13324:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1788521868.201983:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f812e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875400816936320:0@lo:400:kworker.0 00000100:00100000:3.0:1788521868.202023:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875400816936448:0@lo:400:kworker.0 00000100:00080000:2.0:1788521868.202023:0:13324:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788521868.202031:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875400816935808:0@lo:400:kworker.0 00000100:00080000:2.0:1788521868.202046:0:13324:0:(import.c:65:import_set_state_nolock()) ffff996fad74f000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788521868.202064:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875400816936704:0@lo:400:kworker.0 00010000:00010000:1.0:1788521868.202460:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521868.202468:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f829d4e00/0x1b7b50db5927bc47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b7b50db5927bc4e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521868.202476:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d4e00 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:1.0:1788521868.202480:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f829d4e00/0x1b7b50db5927bc47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b7b50db5927bc4e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521868.202489:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f829d4e00/0x1b7b50db5927bc47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b7b50db5927bc4e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521868.202497:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f829d4e00/0x1b7b50db5927bc47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b7b50db5927bc4e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521868.202512:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788521868.202514:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788521868.202517:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788521868.202529:0:5822:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff996f86800800 00010000:00010000:1.0:1788521868.202533:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f829d4e00/0x1b7b50db5927bc47 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1b7b50db5927bc4e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521868.202540:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f829d4e00/0x1b7b50db5927bc47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1b7b50db5927bc4e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521868.202553:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521868.202554:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521868.202557:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521868.202727:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875400816936832:0@lo:39:umount.0 00000400:00000100:0.0:1788521868.202781:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875400816936832 offset 0 length 224: 4 00010000:00010000:3.0:1788521868.431998:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521869.454504:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521870.478449:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788521871.182581:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 672d8d4a-a4f6-4b8b-95c4-7d19376ccba0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788521871.182591:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 672d8d4a-a4f6-4b8b-95c4-7d19376ccba0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788521871.503205:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521872.528291:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521873.550845:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521874.577722:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521875.598994:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788521876.308779:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 672d8d4a-a4f6-4b8b-95c4-7d19376ccba0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788521876.308789:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 672d8d4a-a4f6-4b8b-95c4-7d19376ccba0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788521876.625857:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521877.649343:0:7631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521878.414275:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788521868/real 1788521868] req@ffff996fad6ff800 x1875400816936832/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788521878 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521878.414305:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff996fad6ff800 x1875400816936832/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788521878 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788521878.414346:0:3303:0:(import.c:65:import_set_state_nolock()) ffff996fad74f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788521878.415580:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875400816936832:0@lo:39:umount.0 00000100:00080000:0.0:1788521878.417235:0:13324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788521878.417243:0:13324:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788521878.417250:0:13324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788521878.419337:0:13324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f829d5800/0x1b7b50db5927bc55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927bc5c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521878.419356:0:13324:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f829d5800/0x1b7b50db5927bc55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927bc5c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521878.419365:0:13324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f829d5800/0x1b7b50db5927bc55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b7b50db5927bc5c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521878.419372:0:13324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff996f829d5800/0x1b7b50db5927bc55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b7b50db5927bc5c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521878.419742:0:13324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788521878.419752:0:13324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927be7e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927be85 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521878.419761:0:13324:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927be7e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927be85 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521878.419767:0:13324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927be7e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b7b50db5927be85 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521878.419803:0:13324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927be7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b7b50db5927be85 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521878.420047:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788521878.420054:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f829d5800/0x1b7b50db5927bc55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b7b50db5927bc5c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521878.420061:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d5800 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:2.0:1788521878.420065:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f829d5800/0x1b7b50db5927bc55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b7b50db5927bc5c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521878.420072:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f829d5800/0x1b7b50db5927bc55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b7b50db5927bc5c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521878.420079:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f829d5800/0x1b7b50db5927bc55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b7b50db5927bc5c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521878.420085:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788521878.420088:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1788521878.420099:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff996f86800800 00010000:00010000:2.0:1788521878.420102:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f829d5800/0x1b7b50db5927bc55 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1b7b50db5927bc5c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521878.420109:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f829d5800/0x1b7b50db5927bc55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1b7b50db5927bc5c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521878.420124:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521878.420127:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927be7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b7b50db5927be85 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521878.420306:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d4800 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:2.0:1788521878.420309:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927be7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b7b50db5927be85 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521878.420316:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927be7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b7b50db5927be85 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521878.420322:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927be7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b7b50db5927be85 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521878.420327:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788521878.420329:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788521878.420333:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff996f86800800 00010000:00010000:2.0:1788521878.420336:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927be7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1b7b50db5927be85 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521878.420343:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521878.420345:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521878.420346:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521878.420403:0:13324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788521878.420408:0:13324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927be7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1b7b50db5927be85 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521878.420440:0:13324:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1788521878.420447:0:13324:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1788521878.420450:0:13324:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788521878.421011:0:13324:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788521878.421016:0:13324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788521878.421023:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788521878.421029:0:13324:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788521878.421033:0:13324:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff996fbc57b380) has no exports 00000020:00080000:0.0:1788521878.421059:0:13324:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff996fbc57b380) has no exports 00010000:00010000:1.0:1788521878.422556:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788521878.424076:0:13324:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff996f87debe40 - data ffff996fa80f5d80/ffff996fb7a8e000 00000020:01000000:0.0:1788521878.424309:0:13324:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff996f82fdfd20 - data ffff996f9f5f86c0/ffff996fb4a96800 00100000:10000000:0.0:1788521878.435120:0:13324:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788521878.465009:0:13324:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927bb3d 00000020:00000080:2.0:1788521878.465019:0:13324:0:(genops.c:885:class_export_put()) final put ffff996fae01b000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788521878.465040:0:13324:0:(tgt_mount.c:187:server_put_mount()) put mount ffff996f86ac1800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788521878.465043:0:13324:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996f86ac1800 2 00000020:01000004:2.0:1788521878.465046:0:13324:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff996f86ac1800 from lustre-OST0001 00000020:00000080:2.0:1788521878.465070:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788521878.465080:0:13324:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788521878.465082:0:13324:0:(genops.c:885:class_export_put()) final put ffff996fbfc60800/lustre-OST0001_UUID 00000020:00000080:2.0:1788521878.465085:0:13324:0:(genops.c:844:class_export_destroy()) destroying export ffff996fbfc60800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788521878.465094:0:13324:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788521878.465248:0:13324:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 672d8d4a-a4f6-4b8b-95c4-7d19376ccba0->MGS 00010000:00010000:2.0:1788521878.465263:0:13324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f8392ca00/0x1b7b50db5927ba4f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b7b50db5927ba56 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521878.465274:0:13324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f8392ca00/0x1b7b50db5927ba4f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b7b50db5927ba56 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521878.465280:0:13324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788521878.465283:0:13324:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788521878.465286:0:13324:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788521878.465299:0:13324:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff996f86800800 00010000:00010000:2.0:1788521878.465302:0:13324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f8392ca00/0x1b7b50db5927ba4f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1b7b50db5927ba56 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521878.465317:0:13324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f829d5000/0x1b7b50db5927bc9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b7b50db5927bca2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521878.465324:0:13324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f829d5000/0x1b7b50db5927bc9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b7b50db5927bca2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521878.465329:0:13324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788521878.465331:0:13324:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788521878.465333:0:13324:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788521878.465342:0:13324:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff996f86800800 00010000:00010000:2.0:1788521878.465345:0:13324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f829d5000/0x1b7b50db5927bc9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1b7b50db5927bca2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788521878.466717:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff996fae01b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:2.0:1788521878.467060:0:13324:0:(import.c:65:import_set_state_nolock()) ffff996f86800800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788521878.467066:0:13324:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788521878.467068:0:13324:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788521878.467070:0:13324:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788521878.467074:0:13324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788521878.467093:0:13324:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff996f85d35500 x1875400816936576/t0(0) o250->MGC192.168.206.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788521881 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788521878.467108:0:13324:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788521878.467110:0:13324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:3.0:1788521878.467227:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:672d8d4a-a4f6-4b8b-95c4-7d19376ccba0:3303:1875400816936576:0@lo:250:kworker.0 10000000:01000000:2.0:1788521878.467301:0:13324:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788521878.467308:0:13324:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927b930 00000020:00000080:2.0:1788521878.467315:0:13324:0:(genops.c:885:class_export_put()) final put ffff996f86801000/672d8d4a-a4f6-4b8b-95c4-7d19376ccba0 00000020:01000000:2.0:1788521878.467331:0:13324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.148@tcp (flags='') 00000020:00000080:2.0:1788521878.467336:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788521878.467342:0:13324:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.148@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788521878.467346:0:13324:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff996f8606b380) has no exports 10000000:01000000:1.0:1788521878.467405:0:5830:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:3.0:1788521878.467593:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff996f86801000/672d8d4a-a4f6-4b8b-95c4-7d19376ccba0 for MGC192.168.206.148@tcp 10000000:01000000:2.0:1788521878.467691:0:13324:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.148@tcp: client import never connected 00000100:00080000:2.0:1788521878.467695:0:13324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788521878.467697:0:13324:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788521878.467699:0:13324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788521878.467700:0:13324:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788521878.467742:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788521878.467748:0:13324:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.148@tcp (uuid 672d8d4a-a4f6-4b8b-95c4-7d19376ccba0) 00000020:01000000:2.0:1788521878.467754:0:13324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788521878.467757:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788521878.467761:0:13324:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788521878.467765:0:13324:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff996fad74d800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788521878.467769:0:13324:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff996fbc578000) has exports, disconnecting them 00000020:00080000:2.0:1788521878.467773:0:13324:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff996fad74d800), last request at 1788521682 00000020:00000080:2.0:1788521878.467777:0:13324:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927bb67 00000020:00080000:2.0:1788521878.467787:0:13324:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff996fad74d800): rc 0 00000020:00000080:2.0:1788521878.467791:0:13324:0:(genops.c:885:class_export_put()) final put ffff996fad74d800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788521878.468456:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff996f86800800 for MGC192.168.206.148@tcp 00000020:00000080:3.0:1788521878.468464:0:37:0:(genops.c:885:class_export_put()) final put ffff996f86807000/672d8d4a-a4f6-4b8b-95c4-7d19376ccba0 00000020:00000080:3.0:1788521878.468467:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff996f86807000/672d8d4a-a4f6-4b8b-95c4-7d19376ccba0 for MGC192.168.206.148@tcp 00000020:01000000:3.0:1788521878.468471:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.148@tcp (672d8d4a-a4f6-4b8b-95c4-7d19376ccba0) 00000020:00000080:3.0:1788521878.468707:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff996fad74d800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1788521878.471698:0:13324:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788521878.471706:0:13324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788521878.471711:0:13324:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788521878.471718:0:13324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788521878.471785:0:7631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1788521878.472104:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff996fad74f000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1788521878.507062:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788521878.507686:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788521878.507867:0:5817:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff996f88aa9600:5817] 1 exiting: rc = 0 00000100:00100000:2.0:1788521878.507987:0:5816:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff996f8649e400:5816] 0 exiting: rc = 1 00000100:00100000:3.0:1788521878.508072:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521878.508598:0:7633:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff996fbfc5a000:7633] 4 exiting: rc = 0 00000100:00100000:2.0:1788521878.508771:0:7632:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff996f98834e00:7632] 3 exiting: rc = 0 00000100:00100000:2.0:1788521878.508838:0:5819:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff996f8653cc00:5819] 1 exiting: rc = 0 00000100:00100000:2.0:1788521878.508890:0:5820:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff996f8879f800:5820] 2 exiting: rc = 0 00000100:00100000:0.0:1788521878.509022:0:5818:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff996f88aa8000:5818] 0 exiting: rc = 1 00000100:00100000:3.0:1788521878.509617:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509625:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509631:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509637:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509643:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509649:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509655:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509660:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509666:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509671:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509676:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509681:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509686:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509692:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509697:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509702:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509719:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509723:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509729:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509733:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509738:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509745:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509750:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509756:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509761:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509766:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509771:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509777:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509783:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509788:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509794:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509798:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509804:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509809:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509815:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509821:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509826:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509832:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509837:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509842:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509848:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509854:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509859:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509865:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509871:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509876:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509881:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509886:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509891:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509896:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509901:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509912:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509917:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509922:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509927:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509932:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509937:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509943:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509948:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509952:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509957:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509963:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509968:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.509974:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788521878.510903:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788521878.510912:0:13324:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788521878.510917:0:13324:0:(genops.c:885:class_export_put()) final put ffff996fad748000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788521878.510922:0:13324:0:(genops.c:844:class_export_destroy()) destroying export ffff996fad748000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788521878.510931:0:13324:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1788521878.510974:0:13324:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996f86ac1800 1 00000020:00000080:3.0:1788521878.510981:0:13324:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1b7b50db5927bb0c 00000020:00000080:3.0:1788521878.510988:0:13324:0:(genops.c:885:class_export_put()) final put ffff996f913e0000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788521878.511007:0:13324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788521878.511012:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788521878.511017:0:13324:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788521878.511021:0:13324:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff996fbc57cd40) has no exports 00000020:00000080:1.0:1788521878.511091:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff996f913e0000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788521878.528743:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788521878.528757:0:13324:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788521878.528762:0:13324:0:(genops.c:885:class_export_put()) final put ffff996f86ac5000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788521878.528767:0:13324:0:(genops.c:844:class_export_destroy()) destroying export ffff996f86ac5000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788521878.528777:0:13324:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788521878.528975:0:13324:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff996f86ac1000 00000020:01000000:3.0:1788521878.528998:0:13324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788521878.529002:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788521878.529014:0:13324:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788521878.529018:0:13324:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff996fad7e0000) has no exports 00000020:00000080:3.0:1788521878.529043:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788521878.529048:0:13324:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788521878.529051:0:13324:0:(genops.c:885:class_export_put()) final put ffff996f85cd4800/OSS_uuid 00000020:00000080:3.0:1788521878.529053:0:13324:0:(genops.c:844:class_export_destroy()) destroying export ffff996f85cd4800/OSS_uuid for OSS 00000020:01000000:3.0:1788521878.529060:0:13324:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1788521878.529138:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff996f91c51000:6687] 0 exiting: rc = 1 00000100:00100000:3.0:1788521878.531362:0:11097:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff996fad936a00:11097] 3 exiting: rc = 0 00000100:00100000:3.0:1788521878.531543:0:12322:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff996fb1b96400:12322] 4 exiting: rc = 0 00000100:00080000:0.0:1788521878.531671:0:5829:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788521878.532767:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff996fb552e400:6690] 2 exiting: rc = 0 00000100:00100000:2.0:1788521878.533006:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff996f85de3400:6689] 1 exiting: rc = 0 00000100:00100000:3.0:1788521878.533187:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533197:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533203:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533211:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533216:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533221:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533226:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533232:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533237:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533243:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533247:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533252:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533258:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533263:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533268:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533273:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533279:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533284:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533288:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533293:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533298:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533303:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533307:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533312:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533330:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533335:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533341:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533345:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533350:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533355:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533360:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533365:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533370:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533387:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533392:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533396:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533401:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533406:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533411:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533416:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533422:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533628:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533633:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533638:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533644:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533649:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533654:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533660:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533665:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533671:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533676:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533681:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533687:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533692:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533697:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533702:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533707:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533712:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533717:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533733:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533738:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533743:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533748:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.533760:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521878.535055:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff996f85de3600:6691] 0 exiting: rc = 1 00000100:00100000:1.0:1788521878.535505:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff996f85de2c00:6692] 1 exiting: rc = 0 00000100:00100000:3.0:1788521878.535658:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535668:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535673:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535679:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535684:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535689:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535694:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535699:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535703:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535708:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535713:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535718:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535723:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535728:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535733:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535738:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535742:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535747:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535752:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535757:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535761:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535766:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535771:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535776:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535781:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535786:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535790:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535795:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535800:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535804:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535821:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535826:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535831:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535837:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535841:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535846:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535851:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535855:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535860:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535865:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535870:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535875:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535879:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535885:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535889:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535894:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535902:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535908:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535913:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535919:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535924:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535930:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535934:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535940:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535946:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535951:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535956:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535961:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535965:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535970:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535975:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535980:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535985:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.535989:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.536867:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff996f86137000:6693] 0 exiting: rc = 1 00000100:00100000:2.0:1788521878.537199:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff996fad6b1400:6695] 2 exiting: rc = 0 00000100:00100000:2.0:1788521878.537390:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff996f86136200:6694] 1 exiting: rc = 0 00000100:00100000:3.0:1788521878.537608:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537614:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537620:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537625:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537631:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537637:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537642:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537649:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537654:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537659:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537664:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537668:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537673:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537679:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537684:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537691:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537696:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537702:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537707:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537711:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537717:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537722:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537728:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537733:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537738:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537744:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537749:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537754:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537760:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537765:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537771:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537791:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537797:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537803:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537809:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537821:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537827:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537834:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537839:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537845:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537850:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537855:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537860:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537865:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537870:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537875:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537880:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537885:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537890:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537896:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537901:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537905:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537910:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537915:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537921:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537941:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537947:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537952:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537958:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537965:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537971:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537977:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537983:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.537989:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521878.548110:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff996fad6b1200:6697] 1 exiting: rc = 0 00000100:00100000:2.0:1788521878.548543:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff996fad6b1c00:6696] 0 exiting: rc = 1 00000100:00100000:3.0:1788521878.548678:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548685:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548690:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548696:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548721:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548726:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548743:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548748:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548753:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548760:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548764:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548770:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548775:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548780:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548785:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548790:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548796:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548801:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548806:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548811:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548817:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548822:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548828:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548833:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548838:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548842:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548847:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548851:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548856:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548860:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548865:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548870:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548876:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548880:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548885:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548890:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548896:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548901:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548906:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548911:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548915:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548928:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548932:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548937:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548942:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548947:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548952:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548957:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548962:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548969:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548975:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548982:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548990:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.548997:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.549003:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.549008:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.549013:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.549019:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.549024:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.549029:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.549034:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.549040:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.549044:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.549050:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.552054:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff996f988e5c00:6699] 1 exiting: rc = 0 00000100:00100000:1.0:1788521878.552054:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff996fbc1b8200:6698] 0 exiting: rc = 1 00000100:00100000:3.0:1788521878.556966:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.556976:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.557000:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.557027:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.557034:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.557040:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.557047:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.557055:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.557060:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.557066:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.557072:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.557092:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.557098:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.557104:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.557110:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.557129:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.557136:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.557173:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558357:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558374:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558380:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558386:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558393:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558398:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558404:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558410:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558416:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558503:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558511:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558517:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558523:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558529:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558535:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558541:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558546:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558563:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558574:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558579:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558585:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558591:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558611:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558619:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558625:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558630:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558636:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558642:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558659:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558664:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558670:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558674:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558680:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558687:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558706:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558713:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558718:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558723:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558728:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558733:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558741:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558746:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558753:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558759:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558764:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521878.558769:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788521878.575539:0:13324:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788521896.387802:0:13947:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788521904.429350:0:14407:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788521904.429356:0:14407:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788521904.429467:0:14407:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff996fb47cf000 00000020:01000004:0.0:1788521904.429485:0:14407:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788521904.429493:0:14407:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788521904.429508:0:14407:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff996fb47db380) 00000020:00000080:0.0:1788521904.429520:0:14407:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788521904.453985:0:14407:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788521904.459277:0:14407:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1788521904.459652:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 423: rc = 0 00100000:10000000:0.0:1788521904.459756:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 423: rc = 0 00100000:10000000:0.0:1788521904.459854:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 423: rc = 0 00100000:10000000:0.0:1788521904.459955:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 423: rc = 0 00100000:10000000:0.0:1788521904.460514:0:14407:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788521904.460591:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 423: rc = 0 00100000:10000000:0.0:1788521904.460698:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 423: rc = 0 00100000:10000000:0.0:1788521904.460932:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 425: rc = 0 00100000:10000000:0.0:1788521904.462376:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 301: rc = 0 00100000:10000000:0.0:1788521904.462488:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 301: rc = 0 00100000:10000000:0.0:1788521904.462962:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 564: rc = 0 00100000:10000000:0.0:1788521904.463457:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 564: rc = 0 00100000:10000000:0.0:1788521904.463704:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 564: rc = 0 00100000:10000000:0.0:1788521904.463920:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 564: rc = 0 00100000:10000000:0.0:1788521904.464434:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 564: rc = 0 00100000:10000000:0.0:1788521904.464708:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 564: rc = 0 00100000:10000000:0.0:1788521904.464966:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 564: rc = 0 00100000:10000000:1.0:1788521904.469592:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 564: rc = 0 00100000:10000000:1.0:1788521904.469861:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 564: rc = 0 00100000:10000000:1.0:1788521904.470399:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 564: rc = 0 00100000:10000000:1.0:1788521904.470655:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 564: rc = 0 00100000:10000000:1.0:1788521904.470896:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 564: rc = 0 00100000:10000000:1.0:1788521904.471704:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 305: rc = 0 00100000:10000000:1.0:1788521904.471962:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 305: rc = 0 00100000:10000000:1.0:1788521904.474804:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 305: rc = 0 00100000:10000000:1.0:1788521904.475366:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 305: rc = 0 00100000:10000000:1.0:1788521904.476241:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 305: rc = 0 00100000:10000000:1.0:1788521904.476584:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 305: rc = 0 00100000:10000000:1.0:1788521904.477356:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 305: rc = 0 00100000:10000000:1.0:1788521904.477832:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 305: rc = 0 00100000:10000000:1.0:1788521904.478276:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 305: rc = 0 00100000:10000000:1.0:1788521904.478777:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 305: rc = 0 00100000:10000000:1.0:1788521904.480516:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 305: rc = 0 00100000:10000000:1.0:1788521904.482419:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 305: rc = 0 00100000:10000000:1.0:1788521904.483102:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 305: rc = 0 00100000:10000000:1.0:1788521904.483408:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 305: rc = 0 00100000:10000000:1.0:1788521904.483672:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 305: rc = 0 00100000:10000000:1.0:1788521904.483929:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 305: rc = 0 00100000:10000000:1.0:1788521904.484231:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 305: rc = 0 00100000:10000000:1.0:1788521904.484496:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 305: rc = 0 00100000:10000000:1.0:1788521904.484751:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 305: rc = 0 00100000:10000000:1.0:1788521904.484988:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 305: rc = 0 00100000:10000000:1.0:1788521904.485280:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 305: rc = 0 00100000:10000000:1.0:1788521904.485712:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 305: rc = 0 00100000:10000000:1.0:1788521904.487007:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 305: rc = 0 00100000:10000000:1.0:1788521904.487393:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 305: rc = 0 00100000:10000000:1.0:1788521904.488226:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 305: rc = 0 00100000:10000000:1.0:1788521904.488525:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 305: rc = 0 00100000:10000000:1.0:1788521904.489230:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 305: rc = 0 00100000:10000000:1.0:1788521904.489477:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 305: rc = 0 00100000:10000000:1.0:1788521904.489746:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 305: rc = 0 00100000:10000000:1.0:1788521904.490009:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 305: rc = 0 00100000:10000000:1.0:1788521904.490310:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 305: rc = 0 00100000:10000000:1.0:1788521904.490940:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 305: rc = 0 00100000:10000000:1.0:1788521904.493574:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 578: rc = 0 00100000:10000000:1.0:1788521904.494230:0:14407:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1788521904.494397:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 645: rc = 0 00100000:10000000:1.0:1788521904.494581:0:14407:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1788521904.495337:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 645: rc = 0 00100000:10000000:1.0:1788521904.495536:0:14407:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1788521904.496047:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 645: rc = 0 00100000:10000000:1.0:1788521904.496499:0:14407:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1788521904.496573:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 302: rc = 0 00100000:10000000:1.0:1788521904.498902:0:14407:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1788521904.498985:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 302: rc = 0 00100000:10000000:1.0:1788521904.499215:0:14407:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1788521904.499280:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 302: rc = 0 00000020:00000080:1.0:1788521904.499543:0:14407:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788521904.499550:0:14407:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788521904.499560:0:14407:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b7b50db5927cc31 00000020:01000004:1.0:1788521904.499567:0:14407:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788521904.499571:0:14407:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788521904.499583:0:14407:0:(tgt_mount.c:101:server_register_mount()) register mount ffff996fb47cf000 from MGS 00000020:01000004:1.0:1788521904.499587:0:14407:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788521904.499597:0:14407:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff996f90f199c0) 00000020:00000080:1.0:1788521904.500584:0:14407:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788521904.502498:0:14407:0:(tgt_mount.c:153:server_get_mount()) get mount ffff996fb47cf000 from MGS, refs=2 00080000:01000000:2.0:1788521904.502512:0:14407:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788521904.502521:0:14407:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b7b50db5927cc3f 00000100:00100000:2.0:1788521904.502652:0:14407:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788521904.502792:0:14407:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788521904.502798:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788521904.507082:0:14407:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788521904.507101:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788521904.507796:0:14407:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788521904.507964:0:14407:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788521904.507970:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788521904.508608:0:14407:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788521904.508616:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788521904.509409:0:14407:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788521904.509417:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788521904.511772:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521904.511777:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521904.511780:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521904.512336:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521904.512339:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521904.512341:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521904.512866:0:14407:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788521904.522177:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788521904.536487:0:14407:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788521904.536505:0:14407:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788521904.536508:0:14407:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788521904.542806:0:14416:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788521904.543029:0:14407:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788521904.543234:0:14407:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788521904.544995:0:14407:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788521904.545927:0:14407:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788521904.546102:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788521904.546108:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788521904.546878:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788521904.546886:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788521904.547562:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788521904.547571:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788521904.548448:0:14407:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788521904.548468:0:14407:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.148@tcp' 00000020:01000004:3.0:1788521904.548470:0:14407:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788521904.548505:0:14407:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.148@tcp (typ=mgc) 00000020:00000080:3.0:1788521904.548516:0:14407:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.148@tcp (ffff996fbc57cd40) 00000020:00000080:3.0:1788521904.548532:0:14407:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788521904.548603:0:14407:0:(ldlm_lib.c:102:import_set_conn()) imp ffff996fadf21000@MGC192.168.206.148@tcp: add connection 192.168.206.148@tcp at head 00010000:00010000:3.0:1788521904.548743:0:14407:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.148@tcp-0 is initialized 00000040:01000000:3.0:1788521904.548749:0:14407:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.148@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788521904.551074:0:14421:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788521904.553848:0:14423:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788521904.554101:0:14407:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.148@tcp (uuid 1e22794d-c642-4031-a520-725ebfafbfe5) 00000020:00000080:3.0:1788521904.554122:0:14407:0:(genops.c:1385:class_connect()) connect: client 1e22794d-c642-4031-a520-725ebfafbfe5, cookie 0x1b7b50db5927cc4d 00000100:00080000:3.0:1788521904.554134:0:14407:0:(import.c:545:import_select_connection()) MGC192.168.206.148@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788521904.554163:0:14407:0:(import.c:665:import_select_connection()) MGC192.168.206.148@tcp: import ffff996fadf21000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1788521904.554194:0:14407:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996f860db480 x1875400816936960/t0(0) o250->MGC192.168.206.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788521904.554430:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1e22794d-c642-4031-a520-725ebfafbfe5:3303:1875400816936960:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788521904.554495:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521904.554561:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816936960 00000100:00100000:3.0:1788521904.554568:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816936960 00000100:00100000:3.0:1788521904.554599:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788521904.554606:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1875400816936960:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788521904.554629:0:14418:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1e22794d-c642-4031-a520-725ebfafbfe5@0@lo t0 exp 0000000000000000 cur 404 last 0 00000020:00000080:3.0:1788521904.554654:0:14418:0:(genops.c:1385:class_connect()) connect: client 1e22794d-c642-4031-a520-725ebfafbfe5, cookie 0x1b7b50db5927cc54 00000100:00080000:3.0:1788521904.554776:0:14418:0:(import.c:65:import_set_state_nolock()) ffff996fadf24800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788521904.554824:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+5:3303:x1875400816936960:12345-0@lo:250:mount.lustre.0 Request processed in 217us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521904.554831:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788521904.554870:0:3303:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.148@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788521904.554878:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.206.148@tcp: connect to target with instance 0 00000100:00080000:3.0:1788521904.554885:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.206.148@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788521904.554900:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788521904.554903:0:3303:0:(import.c:65:import_set_state_nolock()) ffff996fadf21000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788521904.554906:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788521904.554923:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788521904.554927:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1e22794d-c642-4031-a520-725ebfafbfe5:3303:1875400816936960:0@lo:250:mount.lustre.0 00000100:00080000:3.0:1788521904.554948:0:14407:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 1e22794d-c642-4031-a520-725ebfafbfe5->MGS 00000020:01000004:3.0:1788521904.554963:0:14407:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788521904.554967:0:14407:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788521904.554980:0:14407:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff996fbc578000) 00000020:00000080:3.0:1788521904.554991:0:14407:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788521904.565952:0:14407:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788521904.572316:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788521904.572325:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788521904.574988:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788521904.575005:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788521904.577746:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788521904.577762:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788521904.581276:0:14407:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788521904.581586:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788521904.581592:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788521904.584579:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788521904.584593:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788521904.634940:0:14407:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788521904.635185:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788521904.635191:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788521904.636424:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788521904.636434:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788521904.638004:0:14407:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788521904.638221:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788521904.638227:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788521904.638779:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788521904.638787:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788521904.639424:0:14407:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788521904.639565:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788521904.639571:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788521904.639995:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788521904.640001:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788521904.640687:0:14407:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788521904.640826:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788521904.640831:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788521904.641365:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788521904.641372:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788521904.661735:0:14407:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788521904.661923:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788521904.661929:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788521904.663477:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788521904.663489:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788521904.664435:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788521904.664445:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788521904.666766:0:14407:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788521904.666793:0:14407:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788521904.666799:0:14407:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.148@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788521904.666924:0:14407:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.148@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788521904.666965:0:14407:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.148@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788521904.667054:0:14407:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788521904.667057:0:14407:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788521904.667058:0:14407:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788521904.667059:0:14407:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788521904.667061:0:14407:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788521904.667062:0:14407:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788521904.667063:0:14407:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788521904.667065:0:14407:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788521904.667070:0:14407:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788521904.667072:0:14407:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788521904.667075:0:14407:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788521904.667077:0:14407:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788521904.667078:0:14407:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788521904.667079:0:14407:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788521904.667080:0:14407:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788521904.667081:0:14407:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788521904.667082:0:14407:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788521904.667083:0:14407:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788521904.667084:0:14407:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788521904.667085:0:14407:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788521904.667086:0:14407:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788521904.667115:0:14407:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788521904.667135:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f812ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816937088:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788521904.667467:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521904.668200:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f8572a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788521904.668388:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816937088 00000100:00100000:2.0:1788521904.668396:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816937088 00000100:00100000:2.0:1788521904.668446:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788521904.668456:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+5:14407:x1875400816937088:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788521904.668521:0:14420:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788521904.668525:0:14420:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788521904.668528:0:14420:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788521904.669734:0:14441:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788521904.670466:0:14420:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1788521904.672420:0:14442:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788521904.672428:0:14442:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788521904.672431:0:14442:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788521904.672468:0:14442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1788521904.673085:0:14420:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788521904.673095:0:14420:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788521904.693682:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+5:14407:x1875400816937088:12345-0@lo:253:mount.lustre.0 Request processed in 25220us (26208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521904.693701:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788521904.693864:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f812ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816937088:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788521904.693881:0:14407:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788521904.693884:0:14407:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788521904.693885:0:14407:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788521904.693887:0:14407:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521904.693888:0:14407:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521904.693889:0:14407:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521904.693890:0:14407:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521904.693891:0:14407:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788521904.693893:0:14407:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788521904.693894:0:14407:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521904.693896:0:14407:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788521904.693918:0:14407:0:(tgt_mount.c:101:server_register_mount()) register mount ffff996fb47cf000 from lustre-MDT0000 10000000:01000000:2.0:1788521904.693944:0:14407:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788521904.693947:0:14407:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788521904.693951:0:14407:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff996fbc57cd40 10000000:01000000:2.0:1788521904.693955:0:14407:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788521904.693963:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff996fbc57cd40 from 1 10000000:01000000:2.0:1788521904.693966:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788521904.694023:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490b800/0x1b7b50db5927cc62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521904.694034:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996fb490b800/0x1b7b50db5927cc62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521904.694043:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996fb490b800/0x1b7b50db5927cc62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521904.694062:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816937216:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788521904.694096:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521904.694179:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521904.694287:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816937216 00000100:00100000:0.0:1788521904.694294:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816937216 00000100:00100000:0.0:1788521904.694326:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521904.694334:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+5:14407:x1875400816937216:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788521904.694355:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521904.694370:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996fb4001600/0x1b7b50db5927cc69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927cc62 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521904.694391:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fb4001600/0x1b7b50db5927cc69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927cc62 expref: 6 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521904.694401:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996fb4001600/0x1b7b50db5927cc69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927cc62 expref: 6 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521904.694409:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4001600, rc 0) 00000100:00100000:0.0:1788521904.694449:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+6:14407:x1875400816937216:12345-0@lo:101:mount.lustre.0 Request processed in 116us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521904.694465:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788521904.694736:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816937216:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521904.694750:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996fb490b800/0x1b7b50db5927cc62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cc69 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521904.694760:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996fb490b800/0x1b7b50db5927cc62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927cc69 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521904.694813:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816937344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521904.694841:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521904.694871:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521904.694937:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816937344 00000100:00100000:0.0:1788521904.694942:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816937344 00000100:00100000:0.0:1788521904.694966:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521904.694974:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+6:14407:x1875400816937344:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788521904.695226:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+6:14407:x1875400816937344:12345-0@lo:501:mount.lustre.0 Request processed in 252us (384us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788521904.695233:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788521904.695808:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816937344:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788521904.695840:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788521904.695858:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490b800/0x1b7b50db5927cc62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cc69 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521904.695868:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996fb490b800/0x1b7b50db5927cc62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cc69 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521904.695876:0:14407:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff996fb47cf000 10000000:01000000:2.0:1788521904.695880:0:14407:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788521904.695885:0:14407:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff996fb47cf000 10000000:01000000:2.0:1788521904.695887:0:14407:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788521904.695891:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff996fb47cf000 from 1 10000000:01000000:2.0:1788521904.695893:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788521904.695915:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490a800/0x1b7b50db5927cc70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521904.695923:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996fb490a800/0x1b7b50db5927cc70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521904.695941:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996fb490a800/0x1b7b50db5927cc70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521904.695956:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816937472:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788521904.695997:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521904.696037:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521904.696237:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816937472 00000100:00100000:0.0:1788521904.696243:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816937472 00000100:00100000:0.0:1788521904.696280:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521904.696288:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5facc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+6:14407:x1875400816937472:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788521904.696299:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521904.696310:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996fb4001e00/0x1b7b50db5927cc77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927cc70 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521904.696338:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fb4001e00/0x1b7b50db5927cc77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927cc70 expref: 7 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521904.696347:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996fb4001e00/0x1b7b50db5927cc77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927cc70 expref: 7 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521904.696355:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4001e00, rc 0) 00000100:00100000:0.0:1788521904.696384:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5facc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+7:14407:x1875400816937472:12345-0@lo:101:mount.lustre.0 Request processed in 97us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521904.696391:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788521904.696773:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816937472:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521904.696787:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996fb490a800/0x1b7b50db5927cc70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cc77 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521904.696795:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996fb490a800/0x1b7b50db5927cc70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927cc77 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521904.696808:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788521904.696824:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490a800/0x1b7b50db5927cc70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cc77 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521904.696830:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996fb490a800/0x1b7b50db5927cc70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cc77 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521904.696837:0:14407:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788521904.696840:0:14407:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788521904.696844:0:14407:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff996fb47cf000 10000000:01000000:2.0:1788521904.696846:0:14407:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788521904.696849:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788521904.696851:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788521904.696865:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490b200/0x1b7b50db5927cc7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521904.696879:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996fb490b200/0x1b7b50db5927cc7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521904.696886:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996fb490b200/0x1b7b50db5927cc7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521904.696898:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816937600:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788521904.696924:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521904.696959:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521904.697132:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816937600 00000100:00100000:3.0:1788521904.697137:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816937600 00000100:00100000:3.0:1788521904.697203:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788521904.697211:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5faf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+7:14407:x1875400816937600:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788521904.697227:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521904.697238:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f8392d600/0x1b7b50db5927cc85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927cc7e expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521904.697254:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8392d600/0x1b7b50db5927cc85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927cc7e expref: 8 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521904.697263:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f8392d600/0x1b7b50db5927cc85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927cc7e expref: 8 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521904.697269:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392d600, rc 0) 00000100:00100000:3.0:1788521904.697304:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5faf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+8:14407:x1875400816937600:12345-0@lo:101:mount.lustre.0 Request processed in 94us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521904.697310:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788521904.697414:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816937600:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521904.697425:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996fb490b200/0x1b7b50db5927cc7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cc85 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521904.697433:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996fb490b200/0x1b7b50db5927cc7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927cc85 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521904.697697:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816937728:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521904.697725:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521904.697788:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521904.697871:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816937728 00000100:00100000:1.0:1788521904.697875:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816937728 00000100:00100000:1.0:1788521904.697908:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788521904.697916:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+8:14407:x1875400816937728:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788521904.698697:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+9:14407:x1875400816937728:12345-0@lo:501:mount.lustre.0 Request processed in 779us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521904.698706:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788521904.698850:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816937728:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521904.698888:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816937856:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788521904.698930:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521904.699001:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521904.699117:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816937856 00000100:00100000:1.0:1788521904.699121:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816937856 00000100:00100000:1.0:1788521904.699256:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788521904.699265:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+9:14407:x1875400816937856:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788521904.699862:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+9:14407:x1875400816937856:12345-0@lo:503:mount.lustre.0 Request processed in 596us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521904.699869:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788521904.699951:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816937856:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788521904.700420:0:14443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6ff800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1e22794d-c642-4031-a520-725ebfafbfe5:14443:1875400816937984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521904.700478:0:14443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521904.700863:0:14443:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788521904.700914:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816937984 00000100:00100000:3.0:1788521904.700924:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816937984 00000100:00100000:0.0:1788521904.700988:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788521904.700999:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5faf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+9:14443:x1875400816937984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521904.701294:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5faf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+9:14443:x1875400816937984:12345-0@lo:502:llog_process_th.0 Request processed in 297us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521904.701302:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788521904.701476:0:14443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6ff800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1e22794d-c642-4031-a520-725ebfafbfe5:14443:1875400816937984:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788521904.701514:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521904.701523:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521904.701525:0:14443:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788521904.701531:0:14443:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788521904.701533:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788521904.701547:0:14443:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff996fad7e19c0) 00000020:00000080:2.0:1788521904.701564:0:14443:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788521904.701569:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788521904.701939:0:14443:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788521904.701948:0:14443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b7b50db5927cc93 00000020:00000080:2.0:1788521904.702202:0:14443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788521904.702207:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521904.702211:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521904.702213:0:14443:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788521904.702215:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521904.702219:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521904.702220:0:14443:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788521904.702223:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788521904.702231:0:14443:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff996fad7e4d40) 00000020:00000080:2.0:1788521904.702241:0:14443:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788521904.702245:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788521904.702247:0:14443:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788521904.702250:0:14443:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788521904.702255:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788521904.702296:0:14443:0:(tgt_mount.c:153:server_get_mount()) get mount ffff996fb47cf000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788521904.702311:0:14443:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff996fad7e3380) 00000020:00000080:2.0:1788521904.702318:0:14443:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788521904.702361:0:14443:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788521904.702375:0:14443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b7b50db5927cca8 00000020:00000080:2.0:1788521904.702473:0:14443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788521904.702478:0:14443:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788521904.702493:0:14443:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1b7b50db5927ccaf 00080000:01000000:2.0:1788521904.702500:0:14443:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788521904.702503:0:14443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b7b50db5927ccb6 00010000:00010000:2.0:1788521904.784935:0:14443:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788521904.785392:0:14443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1788521904.787298:0:14443:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788521904.789413:0:14443:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff996fad7e0000) 00000020:00000080:2.0:1788521904.789434:0:14443:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788521904.789517:0:14443:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788521904.789528:0:14443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b7b50db5927ccc4 00000020:00000080:2.0:1788521904.790448:0:14443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788521904.800085:0:14443:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1b7b50db5927cccb 00000020:00000080:3.0:1788521904.808352:0:14443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788521904.808366:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521904.808373:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521904.808375:0:14443:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788521904.808379:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788521904.808382:0:14443:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1788521904.808383:0:14443:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788521904.808385:0:14443:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788521904.808386:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788521904.808389:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521904.808390:0:14443:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788521904.808392:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521904.808397:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521904.808398:0:14443:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788521904.808403:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788521904.808451:0:14443:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788521904.808466:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521904.808469:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521904.808471:0:14443:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788521904.808473:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788521904.808476:0:14443:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788521904.808479:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521904.808481:0:14443:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788521904.808483:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788521904.808488:0:14443:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.148@tcp to nid 0x20000c0a8ce94 (192.168.206.148@tcp) 00000020:01000000:3.0:1788521904.808522:0:14443:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788521904.808525:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788521904.808538:0:14443:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff996fbc5799c0) 00000020:00000080:3.0:1788521904.808553:0:14443:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788521904.808557:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788521904.808624:0:14443:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788521904.808630:0:14443:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788521904.808636:0:14443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b7b50db5927ccd9 00010000:00080000:3.0:1788521904.808789:0:14443:0:(ldlm_lib.c:102:import_set_conn()) imp ffff996f851a3800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.148@tcp at head 00010000:00010000:3.0:1788521904.809008:0:14443:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1788521904.815947:0:14443:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788521904.816000:0:14443:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788521904.816971:0:14443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788521904.817053:0:14443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788521904.817123:0:14443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788521904.819620:0:14447:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788521904.819628:0:14447:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788521904.822795:0:14443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788521904.822817:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788521904.822862:0:14443:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788521904.822882:0:14443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b7b50db5927cce0 00000100:00080000:1.0:1788521904.822893:0:14443:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788521904.822899:0:14443:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff996f851a3800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1788521904.823106:0:14443:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996f85d37100 x1875400816938112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788521904.823196:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875400816938112:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788521904.823247:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875400816938112 offset 0 length 520: 4 00000100:00080000:1.0:1788521904.823395:0:14443:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788521904.823462:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788521904.823468:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521904.823469:0:14443:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788521904.823472:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788521904.823487:0:14443:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1788521904.823488:0:14443:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788521904.823490:0:14443:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788521904.823492:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788521904.823495:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521904.823496:0:14443:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788521904.823499:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788521904.823502:0:14443:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788521904.823505:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521904.823506:0:14443:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788521904.823525:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788521904.823530:0:14443:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.148@tcp to nid 0x20000c0a8ce94 (192.168.206.148@tcp) 00000020:01000000:1.0:1788521904.823552:0:14443:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788521904.823555:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788521904.823567:0:14443:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff996f90f1b380) 00000020:00000080:1.0:1788521904.823581:0:14443:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788521904.823585:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788521904.823645:0:14443:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788521904.823651:0:14443:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788521904.823657:0:14443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b7b50db5927ccee 00010000:00080000:1.0:1788521904.823698:0:14443:0:(ldlm_lib.c:102:import_set_conn()) imp ffff996fbc6b2800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.148@tcp at head 00010000:00010000:1.0:1788521904.823954:0:14443:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788521904.824169:0:14443:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788521904.824189:0:14443:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788521904.825622:0:14443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788521904.825786:0:14443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788521904.825855:0:14443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788521904.828112:0:14449:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788521904.828118:0:14449:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788521904.832267:0:14443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788521904.833500:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788521904.833558:0:14443:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788521904.833747:0:14443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b7b50db5927ccf5 00000100:00080000:1.0:1788521904.833758:0:14443:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788521904.833777:0:14443:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff996fbc6b2800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1788521904.833812:0:14443:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996f85d35f80 x1875400816938240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788521904.833867:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875400816938240:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788521904.833923:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875400816938240 offset 0 length 520: 4 00000100:00080000:1.0:1788521904.833998:0:14443:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788521904.834108:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788521904.834113:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521904.834114:0:14443:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788521904.834117:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788521904.834120:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521904.834121:0:14443:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788521904.834124:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788521904.834126:0:14443:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788521904.834128:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788521904.834130:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521904.834131:0:14443:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788521904.834134:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788521904.834137:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521904.834138:0:14443:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788521904.834160:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788521904.834190:0:14443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d34380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1e22794d-c642-4031-a520-725ebfafbfe5:14443:1875400816938368:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521904.834243:0:14443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521904.834282:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816938368 00000100:00100000:1.0:1788521904.834298:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816938368 00000100:00100000:1.0:1788521904.834335:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788521904.834343:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+9:14443:x1875400816938368:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521904.834594:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+9:14443:x1875400816938368:12345-0@lo:502:llog_process_th.0 Request processed in 250us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521904.834603:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788521904.834668:0:14443:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb54e5300 going to sleep for 11 seconds 00000100:00100000:1.0:1788521904.834688:0:14443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d34380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1e22794d-c642-4031-a520-725ebfafbfe5:14443:1875400816938368:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788521904.834715:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788521904.834719:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521904.834721:0:14443:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788521904.834724:0:14443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788521904.834800:0:14407:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788521904.834819:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788521904.834835:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490b200/0x1b7b50db5927cc7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cc85 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521904.834846:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996fb490b200/0x1b7b50db5927cc7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cc85 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521904.834854:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff996fb47cf000 from 1 10000000:01000000:2.0:1788521904.834856:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788521904.834883:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490a000/0x1b7b50db5927ccfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521904.834891:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996fb490a000/0x1b7b50db5927ccfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521904.834906:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996fb490a000/0x1b7b50db5927ccfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521904.834921:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816938496:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788521904.834951:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521904.834973:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fbc3d6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788521904.835234:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816938496 00000100:00100000:1.0:1788521904.835239:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816938496 00000100:00100000:1.0:1788521904.835263:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788521904.835270:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+9:14407:x1875400816938496:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788521904.835279:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521904.835425:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996fbc6d5c00/0x1b7b50db5927cd03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927ccfc expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521904.835446:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fbc6d5c00/0x1b7b50db5927cd03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927ccfc expref: 10 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521904.835458:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996fbc6d5c00/0x1b7b50db5927cd03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927ccfc expref: 10 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521904.835466:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d5c00, rc 0) 00000100:00100000:1.0:1788521904.835504:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+10:14407:x1875400816938496:12345-0@lo:101:mount.lustre.0 Request processed in 234us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521904.835511:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788521904.835810:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816938496:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521904.835823:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996fb490a000/0x1b7b50db5927ccfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cd03 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521904.835832:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996fb490a000/0x1b7b50db5927ccfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927cd03 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521904.836451:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816938624:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788521904.836498:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521904.836805:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fbc3d6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788521904.838470:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816938624 00000100:00100000:1.0:1788521904.838483:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816938624 00000100:00100000:1.0:1788521904.838546:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788521904.838556:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+10:14407:x1875400816938624:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788521904.838590:0:14420:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788521904.838596:0:14420:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788521904.838713:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+10:14407:x1875400816938624:12345-0@lo:256:mount.lustre.0 Request processed in 158us (2213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521904.838733:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788521904.838946:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816938624:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788521904.839877:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788521904.839905:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490a000/0x1b7b50db5927ccfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cd03 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521904.840095:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996fb490a000/0x1b7b50db5927ccfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cd03 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521904.840105:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff996fb47cf000 from 1 10000000:01000000:3.0:1788521904.840108:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788521904.840180:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392d000/0x1b7b50db5927cd0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521904.840188:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996f8392d000/0x1b7b50db5927cd0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521904.840198:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f8392d000/0x1b7b50db5927cd0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521904.840218:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860db480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816938752:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788521904.840266:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521904.840432:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86583540 going to sleep for 11 seconds 00000100:00100000:2.0:1788521904.843887:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816938752 00000100:00100000:2.0:1788521904.843901:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816938752 00000100:00100000:2.0:1788521904.844136:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788521904.844173:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+10:14407:x1875400816938752:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521904.844188:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521904.844208:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996fb490ba00/0x1b7b50db5927cd11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927cd0a expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521904.844231:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fb490ba00/0x1b7b50db5927cd11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927cd0a expref: 11 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521904.844262:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996fb490ba00/0x1b7b50db5927cd11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927cd0a expref: 11 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521904.844271:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490ba00, rc 0) 00000100:00100000:2.0:1788521904.844366:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+11:14407:x1875400816938752:12345-0@lo:101:mount.lustre.0 Request processed in 196us (4099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521904.844373:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788521904.844466:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860db480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816938752:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788521904.844484:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f8392d000/0x1b7b50db5927cd0a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cd11 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521904.844493:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f8392d000/0x1b7b50db5927cd0a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927cd11 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521904.844579:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860db480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816938880:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788521904.844612:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521904.850965:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86583540 going to sleep for 11 seconds 00000100:00100000:1.0:1788521904.851036:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816938880 00000100:00100000:1.0:1788521904.851045:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816938880 00000100:00100000:1.0:1788521904.851198:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788521904.851209:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+11:14407:x1875400816938880:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788521904.851976:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+11:14407:x1875400816938880:12345-0@lo:501:mount.lustre.0 Request processed in 767us (7361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521904.851985:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788521904.852066:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860db480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816938880:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788521904.852112:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860db480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816939008:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788521904.852176:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521904.852343:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86583540 going to sleep for 11 seconds 00000100:00100000:2.0:1788521904.852388:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816939008 00000100:00100000:2.0:1788521904.852394:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816939008 00000100:00100000:2.0:1788521904.852421:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788521904.852428:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+11:14407:x1875400816939008:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788521904.852754:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+11:14407:x1875400816939008:12345-0@lo:503:mount.lustre.0 Request processed in 325us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521904.852761:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788521904.852923:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860db480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816939008:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788521904.853464:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860db480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1e22794d-c642-4031-a520-725ebfafbfe5:14451:1875400816939136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521904.853587:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521904.853780:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86583300 going to sleep for 11 seconds 00000100:00100000:2.0:1788521904.853810:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816939136 00000100:00100000:2.0:1788521904.853817:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816939136 00000100:00100000:2.0:1788521904.853855:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788521904.853863:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5faec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+11:14451:x1875400816939136:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521904.854168:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5faec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+11:14451:x1875400816939136:12345-0@lo:502:llog_process_th.0 Request processed in 305us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521904.854176:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788521904.854318:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860db480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1e22794d-c642-4031-a520-725ebfafbfe5:14451:1875400816939136:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788521904.854344:0:14451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521904.854352:0:14451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521904.854354:0:14451:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788521904.854361:0:14451:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff996fb47cf000 00000020:00000080:3.0:1788521904.854364:0:14451:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788521904.854371:0:14451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521904.854374:0:14451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521904.854375:0:14451:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788521904.854377:0:14451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521904.854379:0:14451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521904.854381:0:14451:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788521904.854383:0:14451:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff996fb47cf000 00000020:00000080:3.0:1788521904.854385:0:14451:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788521904.854476:0:14451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521904.854480:0:14451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521904.854482:0:14451:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788521904.854484:0:14451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521904.854487:0:14451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521904.854488:0:14451:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788521904.854499:0:14451:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff996fb47cf000 00000020:00000080:3.0:1788521904.854501:0:14451:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788521904.860039:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860db480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1e22794d-c642-4031-a520-725ebfafbfe5:14451:1875400816939264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521904.860117:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521904.860170:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86583300 going to sleep for 11 seconds 00000100:00100000:0.0:1788521904.860239:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816939264 00000100:00100000:0.0:1788521904.860247:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816939264 00000100:00100000:0.0:1788521904.860296:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788521904.860306:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5faf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+11:14451:x1875400816939264:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521904.860527:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5faf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+11:14451:x1875400816939264:12345-0@lo:502:llog_process_th.0 Request processed in 209us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521904.860535:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788521904.860935:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860db480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1e22794d-c642-4031-a520-725ebfafbfe5:14451:1875400816939264:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788521904.860970:0:14451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521904.860978:0:14451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521904.860980:0:14451:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788521904.860985:0:14451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788521904.861757:0:14407:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788521904.861777:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788521904.861797:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392d000/0x1b7b50db5927cd0a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cd11 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521904.861818:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996f8392d000/0x1b7b50db5927cd0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cd11 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521904.861862:0:14407:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788521904.861865:0:14407:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff996fb47cf000 10000000:01000000:2.0:1788521904.861868:0:14407:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff996fb47cf000 10000000:01000000:2.0:1788521904.861872:0:14407:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788521904.861877:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff996fb47cf000 from 1 10000000:01000000:2.0:1788521904.861880:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788521904.861912:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490be00/0x1b7b50db5927cd18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521904.861920:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996fb490be00/0x1b7b50db5927cd18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521904.861929:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996fb490be00/0x1b7b50db5927cd18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521904.861949:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816939392:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788521904.861996:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521904.862039:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fbc3d63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521904.862057:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816939392 00000100:00100000:2.0:1788521904.862062:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816939392 00000100:00100000:2.0:1788521904.862090:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788521904.862097:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+11:14407:x1875400816939392:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521904.862108:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521904.862121:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996fb490a400/0x1b7b50db5927cd1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927cd18 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521904.862170:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fb490a400/0x1b7b50db5927cd1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927cd18 expref: 12 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521904.862181:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996fb490a400/0x1b7b50db5927cd1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927cd18 expref: 12 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521904.862189:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490a400, rc 0) 00000100:00100000:2.0:1788521904.862221:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+12:14407:x1875400816939392:12345-0@lo:101:mount.lustre.0 Request processed in 124us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521904.862227:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788521904.862265:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816939392:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521904.862277:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996fb490be00/0x1b7b50db5927cd18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cd1f expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521904.862286:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996fb490be00/0x1b7b50db5927cd18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927cd1f expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521904.862328:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816939520:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521904.862353:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521904.862364:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fbc3d63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521904.862784:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816939520 00000100:00100000:0.0:1788521904.862790:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816939520 00000100:00100000:0.0:1788521904.862833:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788521904.862841:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+12:14407:x1875400816939520:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788521904.863101:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+12:14407:x1875400816939520:12345-0@lo:501:mount.lustre.0 Request processed in 261us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521904.863109:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788521904.864227:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816939520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788521904.864277:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860db480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816939648:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788521904.864328:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521904.864364:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86583300 going to sleep for 11 seconds 00000100:00100000:0.0:1788521904.864426:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816939648 00000100:00100000:0.0:1788521904.864431:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816939648 00000100:00100000:0.0:1788521904.864462:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788521904.864469:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f91649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+12:14407:x1875400816939648:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788521904.865049:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f91649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+12:14407:x1875400816939648:12345-0@lo:503:mount.lustre.0 Request processed in 578us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521904.865057:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788521904.865725:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860db480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816939648:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788521904.868972:0:14455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1e22794d-c642-4031-a520-725ebfafbfe5:14455:1875400816939776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521904.869056:0:14455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521904.872372:0:14455:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fbc3d6540 going to sleep for 11 seconds 00000100:00100000:0.0:1788521904.874976:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816939776 00000100:00100000:0.0:1788521904.874989:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816939776 00000100:00100000:0.0:1788521904.875054:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788521904.875065:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f9164b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+12:14455:x1875400816939776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521904.877729:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f9164b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+12:14455:x1875400816939776:12345-0@lo:502:llog_process_th.0 Request processed in 2660us (8665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521904.877743:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788521904.889126:0:14455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1e22794d-c642-4031-a520-725ebfafbfe5:14455:1875400816939776:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788521904.889226:0:14455:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788521904.889257:0:14455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff996faed58000) 00000020:00000080:2.0:1788521904.889276:0:14455:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1788521904.889368:0:14455:0:(tgt_mount.c:153:server_get_mount()) get mount ffff996fb47cf000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788521904.889373:0:14455:0:(tgt_mount.c:187:server_put_mount()) put mount ffff996fb47cf000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788521904.889376:0:14455:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996fb47cf000 4 00010000:00080000:2.0:1788521904.889406:0:14455:0:(ldlm_lib.c:102:import_set_conn()) imp ffff996fac972800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.148@tcp at head 00010000:00010000:2.0:1788521904.892868:0:14455:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1788521904.893077:0:14455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788521904.893113:0:14455:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788521904.893125:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1b7b50db5927cd2d 00000100:00080000:2.0:1788521904.893135:0:14455:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788521904.895893:0:14455:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff996fac972800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1788521904.899496:0:14455:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996fad6fce00 x1875400816939904/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788521904.899798:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400816939904:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788521904.900029:0:14455:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788521904.900630:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521904.900869:0:14455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6ff100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1e22794d-c642-4031-a520-725ebfafbfe5:14455:1875400816940032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521904.900923:0:14455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521904.900951:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816940032 00000100:00100000:2.0:1788521904.900958:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816940032 00000100:00100000:2.0:1788521904.900996:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788521904.901004:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad72a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+12:14455:x1875400816940032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521904.901265:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad72a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+12:14455:x1875400816940032:12345-0@lo:502:llog_process_th.0 Request processed in 260us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521904.901273:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788521904.901311:0:14455:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fbc3d6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521904.901329:0:14455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6ff100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1e22794d-c642-4031-a520-725ebfafbfe5:14455:1875400816940032:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788521904.901357:0:14455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:3.0:1788521904.901906:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816939904 00000100:00100000:3.0:1788521904.901912:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816939904 00000100:00100000:3.0:1788521904.901956:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788521904.901963:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875400816939904:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788521904.902033:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875400816939904:12345-0@lo:38:llog_process_th.0 Request processed in 69us (1403us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788521904.902039:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788521904.902051:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788521904.902058:0:3303:0:(import.c:65:import_set_state_nolock()) ffff996fac972800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788521904.902062:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788521904.902065:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400816939904:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1788521904.902191:0:14407:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788521904.902213:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788521904.902230:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490be00/0x1b7b50db5927cd18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cd1f expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521904.902241:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996fb490be00/0x1b7b50db5927cd18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cd1f expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788521904.902291:0:14407:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788521904.902294:0:14407:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788521904.902295:0:14407:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788521904.902296:0:14407:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788521904.902298:0:14407:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788521904.902304:0:14407:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788521904.902305:0:14407:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788521904.902306:0:14407:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788521904.902308:0:14407:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788521904.902309:0:14407:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788521904.902313:0:14407:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788521904.902314:0:14407:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788521904.902316:0:14407:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788521904.902317:0:14407:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788521904.902317:0:14407:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788521904.902318:0:14407:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788521904.902319:0:14407:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788521904.902320:0:14407:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788521904.902321:0:14407:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788521904.902322:0:14407:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788521904.902323:0:14407:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788521904.902338:0:14407:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788521904.902351:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d36a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816940160:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788521904.902388:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521904.902412:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f92290c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788521904.902727:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816940160 00000100:00100000:0.0:1788521904.902733:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816940160 00000100:00100000:0.0:1788521904.902806:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788521904.902815:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad72a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+12:14407:x1875400816940160:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788521904.902836:0:14420:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788521904.902848:0:14420:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788521904.969753:0:14420:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788521904.969774:0:14420:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788521904.969889:0:14441:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788521904.969894:0:14441:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788521904.969916:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996f8392c600/0x1b7b50db5927cd34 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521904.969954:0:14441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996fbc6d5c00/0x1b7b50db5927cd03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927ccfc expref: 12 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521904.969963:0:14441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996f8392c600/0x1b7b50db5927cd34 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521904.970003:0:14441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996fbc6d5c00/0x1b7b50db5927cd03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927ccfc expref: 12 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521904.970057:0:14441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996fbc6d5c00/0x1b7b50db5927cd03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927ccfc expref: 12 pid: 14418 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521904.970074:0:14441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860db480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14441:1875400816940288:0@lo:104: 00000100:00100000:3.0:1788521904.970322:0:14441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521904.970367:0:14441:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f865839c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521904.970489:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816940288 00000100:00100000:1.0:1788521904.970497:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816940288 00000100:00100000:1.0:1788521904.970544:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788521904.970554:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1e22794d-c642-4031-a520-725ebfafbfe5+3:14441:x1875400816940288:12345-0@lo:104: 00010000:00010000:1.0:1788521904.970566:0:14408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996fb490a000/0x1b7b50db5927ccfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927cd03 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521904.970696:0:14408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788521904.970703:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1e22794d-c642-4031-a520-725ebfafbfe5+3:14441:x1875400816940288:12345-0@lo:104: Request processed in 151us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521904.970710:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788521904.970731:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521904.970743:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996fb490a000/0x1b7b50db5927ccfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927cd03 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521904.970750:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490a000 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:1.0:1788521904.970754:0:14414:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996fb490a000/0x1b7b50db5927ccfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927cd03 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521904.970762:0:14414:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996fb490a000/0x1b7b50db5927ccfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927cd03 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521904.970770:0:14414:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996fb490a000/0x1b7b50db5927ccfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927cd03 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521904.970776:0:14414:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788521904.970803:0:14414:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996fb490a000/0x1b7b50db5927ccfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927cd03 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521904.970810:0:14414:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788521904.970832:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996fb490a000/0x1b7b50db5927ccfc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927cd03 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521904.970839:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996fb490a000/0x1b7b50db5927ccfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927cd03 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521904.970854:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521904.970856:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521904.970857:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521904.970885:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1e22794d-c642-4031-a520-725ebfafbfe5:3304:1875400816940416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788521904.970915:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521904.971009:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816940416 00000100:00100000:0.0:1788521904.971024:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816940416 00010000:00010000:0.0:1788521904.971053:0:14410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996fbc6d5c00/0x1b7b50db5927cd03 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927ccfc expref: 13 pid: 14418 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521904.971295:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788521904.971304:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e22794d-c642-4031-a520-725ebfafbfe5+13:3304:x1875400816940416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521904.971314:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521904.971320:0:14410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996fbc6d5c00/0x1b7b50db5927cd03 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927ccfc expref: 13 pid: 14418 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521904.971335:0:14410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996fbc6d5c00/0x1b7b50db5927cd03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927ccfc expref: 13 pid: 14418 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521904.971351:0:14410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996f8392c600/0x1b7b50db5927cd34 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521904.971359:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8392c600/0x1b7b50db5927cd34 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788521904.971372:0:14410:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001478660s 00010000:00010000:0.0:1788521904.971378:0:14410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996f8392c600/0x1b7b50db5927cd34 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521904.971385:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996f8392c600/0x1b7b50db5927cd34 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521904.971391:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996f8392c600/0x1b7b50db5927cd34 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521904.971397:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996f8392c600/0x1b7b50db5927cd34 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521904.971402:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392c600 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521904.971413:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996f8392c600/0x1b7b50db5927cd34 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521904.971420:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996f8392c600/0x1b7b50db5927cd34 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521904.971428:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996f8392c600/0x1b7b50db5927cd34 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521904.971438:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521904.971471:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e22794d-c642-4031-a520-725ebfafbfe5+13:3304:x1875400816940416:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521904.971478:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788521904.971520:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996fbc6d5c00/0x1b7b50db5927cd03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927ccfc expref: 12 pid: 14418 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521904.971532:0:14441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860db480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14441:1875400816940288:0@lo:104: 00010000:00010000:0.0:1788521904.971556:0:14441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996f8392c600/0x1b7b50db5927cd34 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521904.971565:0:14441:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996f8392c600/0x1b7b50db5927cd34 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521904.971570:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996f8392c600/0x1b7b50db5927cd34 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521904.971577:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8392c600/0x1b7b50db5927cd34 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521904.976127:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1e22794d-c642-4031-a520-725ebfafbfe5:3304:1875400816940416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521904.981566:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad72a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+11:14407:x1875400816940160:12345-0@lo:253:mount.lustre.0 Request processed in 78745us (79169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521904.981581:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788521904.981751:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d36a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:14407:1875400816940160:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788521904.981779:0:14407:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788521904.981783:0:14407:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788521904.981784:0:14407:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788521904.981786:0:14407:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788521904.981787:0:14407:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788521904.981788:0:14407:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788521904.981789:0:14407:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788521904.981790:0:14407:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788521904.981792:0:14407:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788521904.981793:0:14407:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788521904.981794:0:14407:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788521904.981806:0:14407:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788521904.992593:0:14407:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788521904.992783:0:14407:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788521904.993077:0:14407:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788521904.993271:0:14407:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788521904.993533:0:14407:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788521904.993702:0:14407:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788521904.995692:0:14407:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788521904.995857:0:14407:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788521904.996340:0:14407:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788521904.996561:0:14407:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788521905.000904:0:14407:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788521905.001120:0:14407:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1788521905.044483:0:14407:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1788521905.044998:0:14407:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788521905.045497:0:14463:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1788521905.045570:0:14463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788521905.051910:0:14463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788521905.051994:0:14463:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788521905.051999:0:14463:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00080000:3.0:1788521905.052586:0:14462:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788521905.052591:0:14462:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1788521905.060005:0:14407:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788521905.060530:0:14407:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788521905.061026:0:14407:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788521905.061036:0:14407:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788521905.061581:0:14407:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788521905.062971:0:14407:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788521905.063858:0:14407:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788521905.063896:0:14407:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1788521905.065890:0:14407:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1788521905.077996:0:14407:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788521905.139828:0:14407:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788521905.139863:0:14407:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffac0d01c47988 00100000:10000000:1.0:1788521905.139871:0:14407:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788521905.141310:0:14407:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788521905.141324:0:14407:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.148@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788521905.141341:0:14407:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788521905.141366:0:14407:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1788521905.550526:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788521905.807362:0:14423:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788521905.807371:0:14423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff996fb47cf000 from 6 10000000:01000000:1.0:1788521905.807376:0:14423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788521905.807421:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927cd3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521905.807433:0:14423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927cd3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521905.807444:0:14423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927cd3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521905.807480:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d35180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816940544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788521905.807546:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521905.807975:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86741000 going to sleep for 11 seconds 00000100:00100000:2.0:1788521905.808550:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816940544 00000100:00100000:2.0:1788521905.808559:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816940544 00000100:00100000:0.0:1788521905.808693:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788521905.808706:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+11:14423:x1875400816940544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521905.808721:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521905.808736:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996fb4000e00/0x1b7b50db5927cd42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927cd3b expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521905.808760:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fb4000e00/0x1b7b50db5927cd42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927cd3b expref: 12 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521905.808770:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996fb4000e00/0x1b7b50db5927cd42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927cd3b expref: 12 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521905.808791:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4000e00, rc 0) 00000100:00100000:0.0:1788521905.808845:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+12:14423:x1875400816940544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (1298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521905.808878:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d35180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816940544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521905.808894:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927cd3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cd42 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521905.808910:0:14423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927cd3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927cd42 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521905.808923:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788521905.808966:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d35180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816940672:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788521905.809000:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521905.809045:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86741000 going to sleep for 11 seconds 00000100:00100000:0.0:1788521905.809058:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816940672 00000100:00100000:0.0:1788521905.809062:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816940672 00000100:00100000:0.0:1788521905.809093:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788521905.809111:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad72b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+12:14423:x1875400816940672:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788521905.809124:0:14420:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788521905.809428:0:14420:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788521905.809432:0:14420:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788521905.809518:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad72b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+12:14423:x1875400816940672:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 407us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521905.809525:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788521905.810731:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d35180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816940672:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788521905.810923:0:14423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788521905.810932:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927cd3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cd42 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521905.810943:0:14423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927cd3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cd42 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788521905.936574:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788521906.574709:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788521906.958749:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788521907.600374:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521908.627870:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788521908.867799:0:14705:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788521909.646301:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788521910.096118:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788521910.096124:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788521910.096127:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788521910.096130:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788521910.096132:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788521910.096135:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788521910.096139:0:36:0:(import.c:65:import_set_state_nolock()) ffff996fac972800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788521910.096163:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff996fac972800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1788521910.096185:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996f85d37800 x1875400816940928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788521910.096213:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1e22794d-c642-4031-a520-725ebfafbfe5:3305:1875400816940800:0@lo:400:kworker.0 00000100:00100000:1.0:1788521910.096279:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521910.096346:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816940800 00000100:00100000:1.0:1788521910.096354:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816940800 00000100:00100000:1.0:1788521910.096397:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788521910.096407:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad72ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+12:3305:x1875400816940800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521910.096537:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400816940928:0@lo:38:kworker.0 00000100:00100000:0.0:1788521910.096726:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521910.096888:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816940928 00000100:00100000:3.0:1788521910.096893:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816940928 00000100:00100000:3.0:1788521910.096924:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788521910.096931:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1875400816940928:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788521910.096952:0:14427:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 410 last 0 00000020:00000080:3.0:1788521910.097001:0:14427:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1b7b50db5927cd49 00000004:00100000:3.0:1788521910.097214:0:14427:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788521910.097341:0:14427:0:(import.c:65:import_set_state_nolock()) ffff996f913e2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788521910.097450:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400816940928:12345-0@lo:38:kworker.0 Request processed in 518us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521910.097458:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788521910.098374:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad72ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+12:3305:x1875400816940800:12345-0@lo:400:kworker.0 Request processed in 1965us (2091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521910.098386:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788521910.101786:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1e22794d-c642-4031-a520-725ebfafbfe5:3305:1875400816940800:0@lo:400:kworker.0 00010000:00080000:0.0:1788521910.101831:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff996f85d37800 x1875400816940928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788521920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788521910.101898:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788521910.101908:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788521910.101912:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788521910.101926:0:3303:0:(import.c:65:import_set_state_nolock()) ffff996fac972800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788521910.101934:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400816940928:0@lo:38:kworker.0 00010000:00010000:2.0:1788521910.671440:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788521911.498834:0:14856:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd9c47d9a0 20000000:00000080:3.0:1788521911.498850:0:14856:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff996faec63400 uarg=0000000000000000 20000000:01000000:3.0:1788521911.498882:0:14856:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788521911.498888:0:14856:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788521911.498893:0:14856:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788521911.499904:0:14857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1788521911.499997:0:14856:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788521911.508951:0:14856:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788521911.509023:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996fbc6d4a00/0x1b7b50db5927cd50 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521911.509048:0:14856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996fb490ba00/0x1b7b50db5927cd11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927cd0a expref: 11 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521911.509057:0:14856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996fbc6d4a00/0x1b7b50db5927cd50 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521911.509102:0:14856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996fb490ba00/0x1b7b50db5927cd11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927cd0a expref: 11 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521911.509124:0:14856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996fb490ba00/0x1b7b50db5927cd11 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927cd0a expref: 11 pid: 14419 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521911.509138:0:14856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d36300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14856:1875400816941056:0@lo:104: 00000100:00100000:1.0:1788521911.509214:0:14856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521911.509259:0:14856:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86741480 going to sleep for 11 seconds 00000100:00100000:3.0:1788521911.509318:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816941056 00000100:00100000:3.0:1788521911.509326:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816941056 00000100:00100000:3.0:1788521911.509381:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788521911.509391:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1e22794d-c642-4031-a520-725ebfafbfe5+3:14856:x1875400816941056:12345-0@lo:104: 00010000:00010000:3.0:1788521911.509403:0:14409:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996f8392d000/0x1b7b50db5927cd0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927cd11 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521911.509469:0:14409:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788521911.509476:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1e22794d-c642-4031-a520-725ebfafbfe5+3:14856:x1875400816941056:12345-0@lo:104: Request processed in 87us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521911.509483:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788521911.509540:0:14856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d36300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14856:1875400816941056:0@lo:104: 00010000:00010000:2.0:1788521911.509571:0:14856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996fbc6d4a00/0x1b7b50db5927cd50 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521911.509616:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521911.509622:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f8392d000/0x1b7b50db5927cd0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927cd11 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521911.509628:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392d000 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:0.0:1788521911.509632:0:14413:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f8392d000/0x1b7b50db5927cd0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927cd11 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521911.509639:0:14413:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f8392d000/0x1b7b50db5927cd0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927cd11 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521911.509646:0:14413:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f8392d000/0x1b7b50db5927cd0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927cd11 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521911.509651:0:14413:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788521911.509784:0:14413:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f8392d000/0x1b7b50db5927cd0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927cd11 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521911.509791:0:14413:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521911.509812:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f8392d000/0x1b7b50db5927cd0a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927cd11 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521911.509818:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f8392d000/0x1b7b50db5927cd0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927cd11 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521911.509845:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521911.509853:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521911.509854:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521911.509877:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f812eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1e22794d-c642-4031-a520-725ebfafbfe5:3306:1875400816941184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521911.509908:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521911.509948:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816941184 00000100:00100000:0.0:1788521911.509953:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816941184 00010000:00010000:0.0:1788521911.509970:0:14410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996fb490ba00/0x1b7b50db5927cd11 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927cd0a expref: 12 pid: 14419 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521911.510006:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788521911.510012:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e22794d-c642-4031-a520-725ebfafbfe5+12:3306:x1875400816941184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521911.510022:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521911.510027:0:14410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996fb490ba00/0x1b7b50db5927cd11 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927cd0a expref: 12 pid: 14419 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521911.510040:0:14410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996fb490ba00/0x1b7b50db5927cd11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927cd0a expref: 12 pid: 14419 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521911.510053:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996fb490ba00/0x1b7b50db5927cd11 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927cd0a expref: 12 pid: 14419 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521911.510063:0:14410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996fbc6d4a00/0x1b7b50db5927cd50 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521911.510071:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fbc6d4a00/0x1b7b50db5927cd50 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521911.510083:0:14410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996fbc6d4a00/0x1b7b50db5927cd50 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521911.510101:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996fbc6d4a00/0x1b7b50db5927cd50 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521911.510114:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996fbc6d4a00/0x1b7b50db5927cd50 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521911.510120:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996fbc6d4a00/0x1b7b50db5927cd50 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521911.510126:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d4a00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521911.510130:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996fbc6d4a00/0x1b7b50db5927cd50 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521911.510138:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996fbc6d4a00/0x1b7b50db5927cd50 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521911.510176:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996fbc6d4a00/0x1b7b50db5927cd50 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521911.510185:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521911.510222:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e22794d-c642-4031-a520-725ebfafbfe5+11:3306:x1875400816941184:12345-0@lo:103:ldlm_bl.0 Request processed in 210us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521911.510228:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788521911.510333:0:14856:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996fbc6d4a00/0x1b7b50db5927cd50 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521911.510341:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996fbc6d4a00/0x1b7b50db5927cd50 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521911.510348:0:14856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996fbc6d4a00/0x1b7b50db5927cd50 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521911.510529:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f812eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1e22794d-c642-4031-a520-725ebfafbfe5:3306:1875400816941184:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788521911.695267:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788521912.591277:0:14423:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788521912.591286:0:14423:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff996fb47cf000 from 10 10000000:01000000:3.0:1788521912.591291:0:14423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788521912.591984:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392c800/0x1b7b50db5927cd57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521912.592009:0:14423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996f8392c800/0x1b7b50db5927cd57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521912.592020:0:14423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996f8392c800/0x1b7b50db5927cd57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521912.592048:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816941312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788521912.592113:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521912.592251:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f912cb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521912.592366:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816941312 00000100:00100000:1.0:1788521912.592373:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816941312 00000100:00100000:1.0:1788521912.592427:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788521912.592438:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+11:14423:x1875400816941312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521912.592450:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521912.592461:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996fbc6d4c00/0x1b7b50db5927cd5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927cd57 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521912.592488:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fbc6d4c00/0x1b7b50db5927cd5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927cd57 expref: 12 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521912.592498:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996fbc6d4c00/0x1b7b50db5927cd5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927cd57 expref: 12 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521912.592506:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d4c00, rc 0) 00000100:00100000:1.0:1788521912.592553:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+12:14423:x1875400816941312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521912.592561:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788521912.592579:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816941312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521912.592594:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996f8392c800/0x1b7b50db5927cd57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cd5e expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521912.592603:0:14423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996f8392c800/0x1b7b50db5927cd57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927cd5e expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521912.592655:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f812ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816941440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521912.592688:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521912.592709:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90f5ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788521912.593264:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816941440 00000100:00100000:1.0:1788521912.593269:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816941440 00000100:00100000:1.0:1788521912.593376:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788521912.593384:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad72bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+12:14423:x1875400816941440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521912.593633:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad72bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+12:14423:x1875400816941440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521912.593641:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788521912.593868:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f812ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816941440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521912.593906:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f812ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816941568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521912.593943:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521912.593989:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90f5ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788521912.594238:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816941568 00000100:00100000:1.0:1788521912.594243:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816941568 00000100:00100000:1.0:1788521912.594276:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788521912.594284:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad72b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+12:14423:x1875400816941568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521912.594515:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad72b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+12:14423:x1875400816941568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 231us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521912.594523:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788521912.594783:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f812ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816941568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788521912.596992:0:14908:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788521912.598897:0:14423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788521912.598930:0:14423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788521912.598940:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996f8392c800/0x1b7b50db5927cd57 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cd5e expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521912.598951:0:14423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996f8392c800/0x1b7b50db5927cd57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cd5e expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521912.718398:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521913.742253:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521914.190630:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788521904/real 1788521904] req@ffff996f85d35f80 x1875400816938240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521914 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521914.190662:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff996f85d35f80 x1875400816938240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521914 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521914.190673:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788521904/real 1788521904] req@ffff996f85d37100 x1875400816938112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521914 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521914.190685:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff996f85d37100 x1875400816938112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521914 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788521914.190701:0:3303:0:(import.c:65:import_set_state_nolock()) ffff996fbc6b2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788521914.190727:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788521914.190731:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875400816938240:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788521914.190736:0:3303:0:(import.c:65:import_set_state_nolock()) ffff996f851a3800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788521914.190741:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788521914.190759:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875400816938112:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788521914.191191:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788521914.191195:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788521914.191198:0:37:0:(import.c:65:import_set_state_nolock()) ffff996f851a3800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788521914.191203:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 404 00000100:00080000:0.0:1788521914.191209:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788521914.191215:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff996f851a3800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1788521914.191235:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996f812eb800 x1875400816941824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788521914.191280:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f812eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875400816941824:0@lo:8:kworker.0 00000400:00000100:2.0:1788521914.191323:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875400816941824 offset 0 length 520: 4 00000100:00100000:1.0:1788521914.191406:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788521914.191415:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f812e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1e22794d-c642-4031-a520-725ebfafbfe5:3306:1875400816941696:0@lo:400:kworker.0 00000100:00100000:1.0:1788521914.191455:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788521914.191913:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788521914.191917:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788521914.191919:0:37:0:(import.c:65:import_set_state_nolock()) ffff996fbc6b2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788521914.191929:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 404 00000100:00080000:0.0:1788521914.191932:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788521914.191936:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff996fbc6b2800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1788521914.191950:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996f812e9880 x1875400816941952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788521914.192079:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816941696 00000100:00100000:3.0:1788521914.192087:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816941696 00000100:00100000:3.0:1788521914.192130:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788521914.192140:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+12:3306:x1875400816941696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521914.192276:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+12:3306:x1875400816941696:12345-0@lo:400:kworker.0 Request processed in 66us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521914.192284:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788521914.192370:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f812e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1e22794d-c642-4031-a520-725ebfafbfe5:3306:1875400816941696:0@lo:400:kworker.0 00000100:00100000:2.0:1788521914.192432:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f812e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875400816941952:0@lo:8:kworker.0 00000400:00000100:2.0:1788521914.192455:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875400816941952 offset 0 length 520: 4 00000100:00100000:1.0:1788521914.192730:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f812eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816942080:0@lo:400:kworker.0 00000100:00100000:1.0:1788521914.192758:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521914.194982:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816942080 00000100:00100000:0.0:1788521914.195041:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816942080 00000100:00100000:0.0:1788521914.195177:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788521914.195189:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816942080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521914.195272:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816942080:12345-0@lo:400:kworker.0 Request processed in 86us (2512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521914.195279:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788521914.195353:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff996f812eaa00 x1875400816942080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521914.195367:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f812eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816942080:0@lo:400:kworker.0 00010000:00010000:3.0:1788521914.766435:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521915.790715:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788521915.958324:0:15105:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788521915.958328:0:15105:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788521915.958451:0:15105:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff996f85d3d800 00000020:01000004:1.0:1788521915.958466:0:15105:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788521915.958481:0:15105:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788521915.958493:0:15105:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff996f90f18000) 00000020:00000080:1.0:1788521915.958507:0:15105:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788521915.994552:0:15105:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788521915.995682:0:15105:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788521915.997026:0:15105:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788521915.997485:0:15105:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788521915.997947:0:15105:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788521915.999587:0:15105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 675: rc = 0 00100000:10000000:0.0:1788521915.999682:0:15105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 675: rc = 0 00100000:10000000:0.0:1788521915.999777:0:15105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 675: rc = 0 00100000:10000000:0.0:1788521916.000210:0:15105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 538: rc = 0 00100000:10000000:0.0:1788521916.000434:0:15105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 538: rc = 0 00100000:10000000:0.0:1788521916.000670:0:15105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 538: rc = 0 00100000:10000000:2.0:1788521916.004128:0:15105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 538: rc = 0 00100000:10000000:2.0:1788521916.004574:0:15105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 538: rc = 0 00100000:10000000:2.0:1788521916.005507:0:15105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 538: rc = 0 00000020:00000080:2.0:1788521916.006090:0:15105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788521916.006101:0:15105:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788521916.006112:0:15105:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1b7b50db5927cd6c 00000020:01000004:2.0:1788521916.006120:0:15105:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788521916.006165:0:15105:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.148@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788521916.006169:0:15105:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788521916.006175:0:15105:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788521916.006179:0:15105:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788521916.006189:0:15105:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff996faed599c0) 00000020:00000080:2.0:1788521916.006198:0:15105:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788521916.008719:0:15105:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788521916.012513:0:15105:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788521916.012524:0:15105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788521916.013886:0:15105:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788521916.013897:0:15105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788521916.014246:0:15105:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788521916.014312:0:15105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788521916.020136:0:15105:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788521916.020510:0:15105:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788521916.020517:0:15105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788521916.021305:0:15105:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788521916.021314:0:15105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788521916.046962:0:15105:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788521916.047860:0:15105:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788521916.047870:0:15105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788521916.050490:0:15105:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788521916.050506:0:15105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788521916.051768:0:15105:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788521916.051785:0:15105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788521916.056701:0:15105:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788521916.058902:0:15105:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788521916.058920:0:15105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788521916.061093:0:15105:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788521916.061106:0:15105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788521916.106529:0:15105:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788521916.106807:0:15105:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788521916.106814:0:15105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788521916.107940:0:15105:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788521916.107948:0:15105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788521916.108569:0:15105:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788521916.108593:0:15105:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788521916.108600:0:15105:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.148@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788521916.120425:0:15105:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.148@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788521916.120460:0:15105:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.148@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788521916.120465:0:15105:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788521916.120466:0:15105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788521916.120467:0:15105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521916.120473:0:15105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521916.120474:0:15105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521916.120475:0:15105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521916.120476:0:15105:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788521916.120478:0:15105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521916.120479:0:15105:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788521916.120482:0:15105:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788521916.120485:0:15105:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788521916.120486:0:15105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788521916.120487:0:15105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521916.120488:0:15105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521916.120489:0:15105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521916.120490:0:15105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521916.120491:0:15105:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788521916.120491:0:15105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521916.120492:0:15105:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788521916.120517:0:15105:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788521916.120537:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816942208:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788521916.120601:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521916.120694:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86989cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521916.120804:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816942208 00000100:00100000:1.0:1788521916.120812:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816942208 00000100:00100000:1.0:1788521916.120897:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788521916.120908:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad72a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+12:15105:x1875400816942208:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788521916.120934:0:14418:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788521916.120938:0:14418:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788521916.120942:0:14418:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788521916.127919:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad72a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+12:15105:x1875400816942208:12345-0@lo:253:mount.lustre.0 Request processed in 7004us (7308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521916.127950:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788521916.128122:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816942208:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788521916.128140:0:15105:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788521916.128206:0:15105:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788521916.128208:0:15105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788521916.128210:0:15105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521916.128211:0:15105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521916.128213:0:15105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521916.128214:0:15105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521916.128215:0:15105:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788521916.128217:0:15105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521916.128218:0:15105:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788521916.128241:0:15105:0:(tgt_mount.c:101:server_register_mount()) register mount ffff996f85d3d800 from lustre-OST0000 10000000:01000000:2.0:1788521916.128267:0:15105:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788521916.128270:0:15105:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788521916.128276:0:15105:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff996fbc57cd40 local copy 00010000:00010000:2.0:1788521916.128288:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490b800/0x1b7b50db5927cc62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cc69 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521916.128535:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816942336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521916.128573:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521916.128661:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f869893c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521916.128706:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816942336 00000100:00100000:3.0:1788521916.128713:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816942336 00000100:00100000:3.0:1788521916.128864:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788521916.128875:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad728850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+12:15105:x1875400816942336:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788521916.129054:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad728850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+12:15105:x1875400816942336:12345-0@lo:501:mount.lustre.0 Request processed in 181us (479us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788521916.129062:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788521916.129127:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816942336:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788521916.129167:0:15105:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788521916.129308:0:15105:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788521916.129317:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490b800/0x1b7b50db5927cc62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cc69 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521916.129332:0:15105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996fb490b800/0x1b7b50db5927cc62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cc69 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521916.129353:0:15105:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff996f85d3d800 10000000:01000000:2.0:1788521916.129358:0:15105:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788521916.129363:0:15105:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff996fbc57cd40 10000000:01000000:2.0:1788521916.129365:0:15105:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788521916.129369:0:15105:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff996fbc57cd40 from 1 10000000:01000000:2.0:1788521916.129372:0:15105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788521916.129394:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490a200/0x1b7b50db5927cd7a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521916.129403:0:15105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996fb490a200/0x1b7b50db5927cd7a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521916.129412:0:15105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996fb490a200/0x1b7b50db5927cd7a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521916.129437:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816942464:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788521916.129478:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521916.130535:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f869893c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521916.130626:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816942464 00000100:00100000:0.0:1788521916.130634:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816942464 00000100:00100000:0.0:1788521916.130671:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788521916.130693:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+12:15105:x1875400816942464:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788521916.130707:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521916.130788:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996fb4000a00/0x1b7b50db5927cd81 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927cd7a expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521916.130815:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fb4000a00/0x1b7b50db5927cd81 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927cd7a expref: 13 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521916.130827:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996fb4000a00/0x1b7b50db5927cd81 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927cd7a expref: 13 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521916.130837:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4000a00, rc 0) 00000100:00100000:0.0:1788521916.130943:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+13:15105:x1875400816942464:12345-0@lo:101:mount.lustre.0 Request processed in 252us (1466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521916.130950:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788521916.131135:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816942464:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521916.131178:0:15105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996fb490a200/0x1b7b50db5927cd7a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cd81 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521916.131188:0:15105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996fb490a200/0x1b7b50db5927cd7a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927cd81 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521916.131218:0:15105:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788521916.131226:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490a200/0x1b7b50db5927cd7a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cd81 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521916.131234:0:15105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996fb490a200/0x1b7b50db5927cd7a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cd81 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521916.131242:0:15105:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788521916.131246:0:15105:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788521916.131251:0:15105:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788521916.131254:0:15105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788521916.131274:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490aa00/0x1b7b50db5927cd88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521916.131282:0:15105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996fb490aa00/0x1b7b50db5927cd88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521916.131289:0:15105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996fb490aa00/0x1b7b50db5927cd88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521916.131312:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816942592:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788521916.131345:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521916.131377:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f869893c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521916.131433:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816942592 00000100:00100000:3.0:1788521916.131438:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816942592 00000100:00100000:3.0:1788521916.131476:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788521916.131484:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+13:15105:x1875400816942592:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788521916.131492:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521916.131501:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f8392c400/0x1b7b50db5927cd8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927cd88 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521916.131517:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8392c400/0x1b7b50db5927cd8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927cd88 expref: 14 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521916.131535:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f8392c400/0x1b7b50db5927cd8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927cd88 expref: 14 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521916.131543:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392c400, rc 0) 00000100:00100000:3.0:1788521916.131574:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+14:15105:x1875400816942592:12345-0@lo:101:mount.lustre.0 Request processed in 91us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521916.131580:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788521916.131663:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816942592:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521916.131673:0:15105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996fb490aa00/0x1b7b50db5927cd88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cd8f expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521916.131680:0:15105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996fb490aa00/0x1b7b50db5927cd88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927cd8f expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788521916.132559:0:15105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788521916.134514:0:15105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788521916.134875:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788521916.134923:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788521916.135625:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788521916.135694:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788521916.135728:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788521916.135755:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788521916.135904:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788521916.135912:0:15105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788521916.136012:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816942720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521916.136415:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521916.136456:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86989180 going to sleep for 11 seconds 00000100:00100000:3.0:1788521916.136568:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816942720 00000100:00100000:3.0:1788521916.136575:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816942720 00000100:00100000:3.0:1788521916.136618:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788521916.136626:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+14:15105:x1875400816942720:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788521916.137020:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+14:15105:x1875400816942720:12345-0@lo:501:mount.lustre.0 Request processed in 393us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521916.137028:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788521916.137101:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816942720:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788521916.137138:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f812eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816942848:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788521916.137317:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521916.137345:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90f5ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521916.137450:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816942848 00000100:00100000:1.0:1788521916.137455:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816942848 00000100:00100000:1.0:1788521916.137483:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788521916.137491:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad72b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+14:15105:x1875400816942848:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788521916.137769:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad72b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+14:15105:x1875400816942848:12345-0@lo:503:mount.lustre.0 Request processed in 279us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521916.137776:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788521916.137845:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f812eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816942848:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788521916.138842:0:15105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788521916.138911:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f812eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816942976:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788521916.138972:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521916.139036:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90f5ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521916.139075:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816942976 00000100:00100000:2.0:1788521916.139080:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816942976 00000100:00100000:2.0:1788521916.139117:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788521916.139125:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+14:15105:x1875400816942976:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788521916.139433:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+14:15105:x1875400816942976:12345-0@lo:502:mount.lustre.0 Request processed in 308us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521916.139440:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788521916.139495:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f812eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816942976:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788521916.139716:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788521916.139764:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788521916.139792:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788521916.139829:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788521916.139859:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788521916.139885:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788521916.139922:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788521916.139962:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788521916.139996:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1788521916.140049:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1788521916.140080:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1788521916.140117:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1788521916.140326:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f812eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816943104:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788521916.140455:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521916.140518:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90f5ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521916.140557:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816943104 00000100:00100000:0.0:1788521916.140562:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816943104 00000100:00100000:0.0:1788521916.140598:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788521916.140606:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+14:15105:x1875400816943104:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788521916.140801:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+14:15105:x1875400816943104:12345-0@lo:502:mount.lustre.0 Request processed in 194us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521916.140810:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788521916.140881:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f812eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816943104:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788521916.140963:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788521916.140974:0:15105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788521916.141891:0:15119:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788521916.141900:0:15119:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788521916.141906:0:15119:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521916.141908:0:15119:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788521916.141916:0:15119:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788521916.141929:0:15119:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff996fbc57b380) 00000020:00000080:3.0:1788521916.141965:0:15119:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788521916.141972:0:15119:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788521916.142042:0:15119:0:(tgt_mount.c:153:server_get_mount()) get mount ffff996f85d3d800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788521916.142049:0:15119:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788521916.142055:0:15119:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1b7b50db5927cd9d 00010000:00010000:3.0:1788521916.146460:0:15119:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788521916.146866:0:15119:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1788521916.148630:0:15119:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788521916.150242:0:15119:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788521916.150252:0:15119:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521916.150259:0:15119:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521916.150261:0:15119:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788521916.150264:0:15119:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788521916.150267:0:15119:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1788521916.150268:0:15119:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788521916.150270:0:15119:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788521916.150271:0:15119:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788521916.150274:0:15119:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521916.150275:0:15119:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788521916.150278:0:15119:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521916.150293:0:15119:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521916.150294:0:15119:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788521916.150299:0:15119:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788521916.150301:0:15119:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788521916.150303:0:15119:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521916.150305:0:15119:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521916.150307:0:15119:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788521916.150309:0:15119:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521916.150312:0:15119:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521916.150313:0:15119:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788521916.150316:0:15119:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788521916.150377:0:15119:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521916.150381:0:15119:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521916.150383:0:15119:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788521916.150386:0:15119:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1788521916.150490:0:15105:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788521916.150521:0:15105:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788521916.151053:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490aa00/0x1b7b50db5927cd88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cd8f expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521916.151067:0:15105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996fb490aa00/0x1b7b50db5927cd88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cd8f expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521916.151076:0:15105:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff996f85d3d800 from 1 10000000:01000000:1.0:1788521916.151079:0:15105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788521916.151127:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5200/0x1b7b50db5927cda4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521916.151137:0:15105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5200/0x1b7b50db5927cda4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521916.151200:0:15105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5200/0x1b7b50db5927cda4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521916.151226:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d35f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816943232:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788521916.151667:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521916.152243:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816943232 00000100:00100000:3.0:1788521916.152252:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816943232 00000100:00100000:3.0:1788521916.152294:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788521916.152303:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+14:15105:x1875400816943232:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788521916.152316:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521916.152330:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f8392c000/0x1b7b50db5927cdab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927cda4 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521916.152354:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8392c000/0x1b7b50db5927cdab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927cda4 expref: 15 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521916.152364:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f8392c000/0x1b7b50db5927cdab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927cda4 expref: 15 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521916.152373:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392c000, rc 0) 00000100:00100000:3.0:1788521916.152500:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+15:15105:x1875400816943232:12345-0@lo:101:mount.lustre.0 Request processed in 197us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521916.152508:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788521916.152523:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f8ad0e240 going to sleep for 11 seconds 00000100:00100000:1.0:1788521916.152551:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d35f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816943232:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788521916.152651:0:15105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5200/0x1b7b50db5927cda4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cdab expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521916.152661:0:15105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5200/0x1b7b50db5927cda4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927cdab expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788521916.153938:0:15105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788521916.155059:0:15105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788521916.155464:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788521916.155510:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788521916.155591:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788521916.155600:0:15105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788521916.155671:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d35f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816943360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788521916.155741:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521916.155790:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f8ad0e240 going to sleep for 11 seconds 00000100:00100000:0.0:1788521916.156113:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816943360 00000100:00100000:0.0:1788521916.156120:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816943360 00000100:00100000:0.0:1788521916.156197:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788521916.156208:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+15:15105:x1875400816943360:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788521916.156470:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+15:15105:x1875400816943360:12345-0@lo:501:mount.lustre.0 Request processed in 263us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521916.156478:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788521916.156701:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d35f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816943360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788521916.156743:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d35f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816943488:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788521916.156785:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521916.156820:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f8ad0e240 going to sleep for 11 seconds 00000100:00100000:3.0:1788521916.156891:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816943488 00000100:00100000:3.0:1788521916.156896:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816943488 00000100:00100000:3.0:1788521916.156930:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788521916.156938:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+15:15105:x1875400816943488:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788521916.157105:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+15:15105:x1875400816943488:12345-0@lo:503:mount.lustre.0 Request processed in 167us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521916.157113:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788521916.157220:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d35f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816943488:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788521916.157731:0:15105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788521916.157785:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d35f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816943616:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788521916.157820:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521916.157852:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f8ad0e240 going to sleep for 11 seconds 00000100:00100000:0.0:1788521916.157903:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816943616 00000100:00100000:0.0:1788521916.157907:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816943616 00000100:00100000:0.0:1788521916.157993:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788521916.158002:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+15:15105:x1875400816943616:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788521916.158182:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+15:15105:x1875400816943616:12345-0@lo:502:mount.lustre.0 Request processed in 181us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521916.158190:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788521916.158270:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d35f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816943616:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788521916.158483:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788521916.158538:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788521916.158691:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788521916.158732:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788521916.158784:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788521916.158829:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788521916.158863:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788521916.158896:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788521916.158920:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d35f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816943744:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788521916.159321:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521916.159354:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f8ad0e240 going to sleep for 11 seconds 00000100:00100000:0.0:1788521916.159438:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816943744 00000100:00100000:0.0:1788521916.159453:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816943744 00000100:00100000:0.0:1788521916.159491:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788521916.159497:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+15:15105:x1875400816943744:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788521916.159820:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+15:15105:x1875400816943744:12345-0@lo:502:mount.lustre.0 Request processed in 322us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521916.159828:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788521916.159914:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d35f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816943744:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788521916.160019:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788521916.160420:0:15105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788521916.161347:0:15123:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521916.161359:0:15123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521916.161362:0:15123:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788521916.161368:0:15123:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff996f85d3d800 00000020:00000080:2.0:1788521916.161371:0:15123:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788521916.161378:0:15123:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521916.161381:0:15123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521916.161382:0:15123:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788521916.161384:0:15123:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521916.161387:0:15123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521916.161388:0:15123:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788521916.161391:0:15123:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff996f85d3d800 00000020:00000080:2.0:1788521916.161393:0:15123:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788521916.167599:0:15123:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521916.167611:0:15123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521916.167614:0:15123:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788521916.167617:0:15123:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521916.167622:0:15123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521916.167623:0:15123:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788521916.167628:0:15123:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff996f85d3d800 00000020:00000080:2.0:1788521916.167631:0:15123:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788521916.167735:0:15123:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521916.167739:0:15123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521916.167740:0:15123:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788521916.167744:0:15123:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788521916.170285:0:15105:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788521916.170325:0:15105:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788521916.170346:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5200/0x1b7b50db5927cda4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cdab expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521916.170359:0:15105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5200/0x1b7b50db5927cda4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cdab expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521916.170416:0:15105:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788521916.170419:0:15105:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff996f85d3d800 10000000:01000000:0.0:1788521916.170422:0:15105:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff996f85d3d800 10000000:01000000:0.0:1788521916.170427:0:15105:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788521916.170433:0:15105:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff996f85d3d800 from 1 10000000:01000000:0.0:1788521916.170436:0:15105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788521916.170471:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb4001400/0x1b7b50db5927cdb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521916.170480:0:15105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996fb4001400/0x1b7b50db5927cdb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521916.170490:0:15105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996fb4001400/0x1b7b50db5927cdb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521916.170513:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f812e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816943872:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788521916.170582:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521916.170632:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90f5ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788521916.170838:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816943872 00000100:00100000:1.0:1788521916.170846:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816943872 00000100:00100000:1.0:1788521916.170989:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788521916.170999:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+15:15105:x1875400816943872:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788521916.171011:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521916.171024:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996fbc6d4600/0x1b7b50db5927cdb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927cdb2 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521916.171056:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fbc6d4600/0x1b7b50db5927cdb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927cdb2 expref: 16 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521916.171066:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996fbc6d4600/0x1b7b50db5927cdb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927cdb2 expref: 16 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521916.171076:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d4600, rc 0) 00000100:00100000:1.0:1788521916.172006:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+16:15105:x1875400816943872:12345-0@lo:101:mount.lustre.0 Request processed in 1006us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521916.172010:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f812e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816943872:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788521916.172019:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:0.0:1788521916.172034:0:15105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996fb4001400/0x1b7b50db5927cdb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cdb9 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521916.172046:0:15105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996fb4001400/0x1b7b50db5927cdb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927cdb9 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788521916.172775:0:15105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1788521916.173092:0:15105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788521916.173442:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788521916.173503:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788521916.173540:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788521916.173589:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788521916.173628:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788521916.173674:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788521916.173709:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788521916.173737:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788521916.173799:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788521916.173832:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788521916.173864:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788521916.173906:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788521916.173940:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788521916.173989:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788521916.174035:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788521916.174067:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788521916.174098:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788521916.174168:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788521916.174207:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788521916.174245:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788521916.174314:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788521916.174357:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788521916.174409:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788521916.174485:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788521916.174545:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788521916.174591:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788521916.174647:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788521916.174695:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788521916.175117:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788521916.175126:0:15105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1788521916.175252:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f812e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816944000:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788521916.175316:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521916.175377:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816944000 00000100:00100000:0.0:1788521916.175377:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90f5ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788521916.175386:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816944000 00000100:00100000:2.0:1788521916.175437:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788521916.175448:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+16:15105:x1875400816944000:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521916.175715:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+16:15105:x1875400816944000:12345-0@lo:501:mount.lustre.0 Request processed in 267us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521916.175724:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788521916.175735:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f812e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816944000:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788521916.175769:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f812e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816944128:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788521916.175804:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521916.175826:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90f5ab40 going to sleep for 11 seconds 00000040:00080000:3.0:1788521916.176061:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788521916.176118:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816944128 00000100:00100000:3.0:1788521916.176123:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816944128 00000100:00100000:3.0:1788521916.176176:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788521916.176192:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+16:15105:x1875400816944128:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788521916.176358:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+16:15105:x1875400816944128:12345-0@lo:503:mount.lustre.0 Request processed in 167us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521916.176370:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788521916.176370:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f812e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816944128:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788521916.176900:0:15105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788521916.176973:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f812e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816944256:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788521916.177018:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521916.177052:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90f5ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788521916.177759:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816944256 00000100:00100000:3.0:1788521916.177766:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816944256 00000100:00100000:3.0:1788521916.177830:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788521916.177839:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+16:15105:x1875400816944256:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788521916.178110:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+16:15105:x1875400816944256:12345-0@lo:502:mount.lustre.0 Request processed in 273us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521916.178118:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788521916.181578:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f812e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816944256:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788521916.181880:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788521916.181937:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788521916.181983:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788521916.182026:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788521916.182055:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788521916.182100:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788521916.182135:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788521916.182194:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788521916.182262:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788521916.182294:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788521916.182321:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788521916.182358:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788521916.182386:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788521916.182425:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788521916.182468:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788521916.182501:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788521916.182534:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788521916.182573:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788521916.182605:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788521916.182638:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788521916.182683:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788521916.182714:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788521916.182757:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788521916.182808:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788521916.182857:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788521916.182887:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788521916.182937:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788521916.182986:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788521916.183016:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788521916.183061:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788521916.183101:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788521916.183131:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788521916.183195:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788521916.183271:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788521916.183323:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788521916.183396:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788521916.183442:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788521916.183487:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788521916.183525:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788521916.183553:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788521916.183598:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816944384:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788521916.183671:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521916.183711:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f983fd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521916.183922:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816944384 00000100:00100000:1.0:1788521916.183930:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816944384 00000100:00100000:1.0:1788521916.183989:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788521916.184000:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+16:15105:x1875400816944384:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788521916.184311:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+16:15105:x1875400816944384:12345-0@lo:502:mount.lustre.0 Request processed in 311us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521916.184320:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788521916.184970:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816944384:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788521916.185088:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788521916.185103:0:15105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788521916.186629:0:15128:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788521916.186644:0:15128:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff996f90f1cd40) 00000020:00000080:1.0:1788521916.186677:0:15128:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788521916.186747:0:15128:0:(tgt_mount.c:153:server_get_mount()) get mount ffff996f85d3d800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788521916.186750:0:15128:0:(tgt_mount.c:187:server_put_mount()) put mount ffff996f85d3d800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788521916.186753:0:15128:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996f85d3d800 3 00010000:00080000:1.0:1788521916.187129:0:15128:0:(ldlm_lib.c:102:import_set_conn()) imp ffff996f86ac1000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.148@tcp at head 00010000:00010000:1.0:1788521916.190676:0:15128:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1788521916.190856:0:15128:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788521916.190893:0:15128:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788521916.190911:0:15128:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x1b7b50db5927cdc7 00000100:00080000:1.0:1788521916.190921:0:15128:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788521916.190927:0:15128:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff996f86ac1000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1788521916.190982:0:15128:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996f85d35f80 x1875400816944512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788521916.191005:0:15128:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788521916.191126:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875400816944512:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788521916.191218:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788521916.192701:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788521916.192708:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788521916.192711:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788521916.192714:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788521916.192834:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788521916.192847:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f812ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816944640:0@lo:400:kworker.0 00000100:00100000:0.0:1788521916.193023:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521916.193072:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816944512 00000100:00100000:0.0:1788521916.193079:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816944512 00000100:00100000:0.0:1788521916.193106:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816944640 00000100:00100000:0.0:1788521916.193110:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816944640 00000100:00100000:0.0:1788521916.193135:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788521916.193160:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816944640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521916.193207:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816944640:12345-0@lo:400:kworker.0 Request processed in 65us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521916.193214:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788521916.193232:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521916.193236:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad6ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3303:x1875400816944512:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788521916.193256:0:14426:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 416 last 0 00000020:00000080:0.0:1788521916.193291:0:14426:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1b7b50db5927cdce 00000004:00100000:0.0:1788521916.193305:0:14426:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788521916.193338:0:14426:0:(import.c:65:import_set_state_nolock()) ffff996f9198d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788521916.193376:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad6ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875400816944512:12345-0@lo:38:llog_process_th.0 Request processed in 138us (2159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521916.193383:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788521916.193420:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff996f812ea680 x1875400816944640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521916.193434:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f812ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816944640:0@lo:400:kworker.0 00010000:00080000:0.0:1788521916.193469:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff996f85d35f80 x1875400816944512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788521926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521916.193491:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788521916.193497:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788521916.193505:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788521916.193510:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788521916.193512:0:3303:0:(import.c:65:import_set_state_nolock()) ffff996f86ac1000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788521916.193517:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875400816944512:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788521916.195099:0:15128:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1788521916.195184:0:15105:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788521916.195213:0:15105:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788521916.195227:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb4001400/0x1b7b50db5927cdb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cdb9 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521916.195238:0:15105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996fb4001400/0x1b7b50db5927cdb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cdb9 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788521916.195288:0:15105:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788521916.195289:0:15105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788521916.195290:0:15105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788521916.195291:0:15105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788521916.195292:0:15105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788521916.195293:0:15105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788521916.195294:0:15105:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788521916.195295:0:15105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788521916.195296:0:15105:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788521916.195299:0:15105:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788521916.195300:0:15105:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788521916.195305:0:15105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788521916.195306:0:15105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788521916.195307:0:15105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788521916.195307:0:15105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788521916.195308:0:15105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788521916.195309:0:15105:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788521916.195310:0:15105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788521916.195311:0:15105:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788521916.195335:0:15105:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788521916.195354:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816944768:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788521916.195423:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521916.195457:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816944768 00000100:00100000:3.0:1788521916.195464:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816944768 00000100:00100000:3.0:1788521916.195503:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788521916.195510:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+16:15105:x1875400816944768:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788521916.195546:0:14418:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788521916.195560:0:14418:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788521916.196111:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f85c9d240 going to sleep for 11 seconds 20000000:01000000:3.0:1788521916.232308:0:14418:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788521916.232327:0:14418:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788521916.232587:0:14441:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788521916.232592:0:14441:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788521916.232611:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996fbc6d4200/0x1b7b50db5927cdd5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521916.232629:0:14441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996fb4000e00/0x1b7b50db5927cd42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927cd3b expref: 16 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521916.232638:0:14441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996fbc6d4200/0x1b7b50db5927cdd5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521916.232676:0:14441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996fb4000e00/0x1b7b50db5927cd42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927cd3b expref: 16 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521916.232698:0:14441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996fb4000e00/0x1b7b50db5927cd42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927cd3b expref: 16 pid: 14418 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521916.232713:0:14441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d36300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14441:1875400816944896:0@lo:104: 00000100:00100000:1.0:1788521916.232775:0:14441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521916.232817:0:14441:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f862a93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521916.232938:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816944896 00000100:00100000:3.0:1788521916.232946:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816944896 00000100:00100000:3.0:1788521916.233072:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788521916.233082:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1e22794d-c642-4031-a520-725ebfafbfe5+3:14441:x1875400816944896:12345-0@lo:104: 00010000:00010000:3.0:1788521916.233095:0:14409:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927cd3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927cd42 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521916.233168:0:14409:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788521916.233314:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1e22794d-c642-4031-a520-725ebfafbfe5+3:14441:x1875400816944896:12345-0@lo:104: Request processed in 234us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521916.233322:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788521916.233343:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521916.233361:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927cd3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927cd42 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521916.233368:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d4800 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:3.0:1788521916.233372:0:14413:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927cd3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927cd42 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521916.233380:0:14413:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927cd3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927cd42 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521916.233387:0:14413:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927cd3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927cd42 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521916.233392:0:14413:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1788521916.233658:0:14441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d36300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14441:1875400816944896:0@lo:104: 00010000:00010000:1.0:1788521916.233678:0:14441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996fbc6d4200/0x1b7b50db5927cdd5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521916.234087:0:14413:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927cd3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927cd42 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521916.234094:0:14413:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788521916.234279:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1e22794d-c642-4031-a520-725ebfafbfe5:3306:1875400816945024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788521916.234323:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521916.234393:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816945024 00000100:00100000:1.0:1788521916.234399:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816945024 00010000:00010000:1.0:1788521916.234420:0:14412:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996fb4000e00/0x1b7b50db5927cd42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927cd3b expref: 17 pid: 14418 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521916.234446:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788521916.234454:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad6fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e22794d-c642-4031-a520-725ebfafbfe5+17:3306:x1875400816945024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788521916.234465:0:14412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521916.234470:0:14412:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996fb4000e00/0x1b7b50db5927cd42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927cd3b expref: 17 pid: 14418 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521916.234487:0:14412:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996fb4000e00/0x1b7b50db5927cd42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927cd3b expref: 17 pid: 14418 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521916.234515:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996fb4000e00/0x1b7b50db5927cd42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927cd3b expref: 17 pid: 14418 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521916.234531:0:14412:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996fbc6d4200/0x1b7b50db5927cdd5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521916.234539:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fbc6d4200/0x1b7b50db5927cdd5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788521916.234552:0:14412:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001960139s 00010000:00010000:1.0:1788521916.234556:0:14412:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996fbc6d4200/0x1b7b50db5927cdd5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521916.234562:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996fbc6d4200/0x1b7b50db5927cdd5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521916.234581:0:14412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996fbc6d4200/0x1b7b50db5927cdd5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521916.234588:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996fbc6d4200/0x1b7b50db5927cdd5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521916.234593:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d4200 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:1.0:1788521916.234597:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996fbc6d4200/0x1b7b50db5927cdd5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521916.234604:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996fbc6d4200/0x1b7b50db5927cdd5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521916.234617:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996fbc6d4200/0x1b7b50db5927cdd5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521916.234626:0:14412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788521916.234686:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927cd3b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927cd42 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521916.234694:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4800/0x1b7b50db5927cd3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927cd42 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521916.234709:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521916.234711:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521916.234713:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521916.238134:0:14441:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996fbc6d4200/0x1b7b50db5927cdd5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521916.238232:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996fbc6d4200/0x1b7b50db5927cdd5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521916.238242:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996fbc6d4200/0x1b7b50db5927cdd5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521916.240649:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad6fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e22794d-c642-4031-a520-725ebfafbfe5+16:3306:x1875400816945024:12345-0@lo:103:ldlm_bl.0 Request processed in 6188us (6317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521916.240662:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788521916.240708:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1e22794d-c642-4031-a520-725ebfafbfe5:3306:1875400816945024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521916.241463:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+15:15105:x1875400816944768:12345-0@lo:253:mount.lustre.0 Request processed in 45951us (46038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521916.241472:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788521916.241661:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15105:1875400816944768:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788521916.241675:0:15105:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788521916.241678:0:15105:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788521916.241692:0:15105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788521916.241693:0:15105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521916.241694:0:15105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521916.241696:0:15105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521916.241697:0:15105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521916.241698:0:15105:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788521916.241700:0:15105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521916.241701:0:15105:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788521916.242072:0:15105:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788521916.256591:0:15105:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788521916.256795:0:15105:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788521916.256947:0:15105:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788521916.257121:0:15105:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788521916.257307:0:15105:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788521916.257514:0:15105:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788521916.261340:0:15105:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788521916.323240:0:15105:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788521916.323247:0:15105:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788521916.323283:0:15105:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788521916.323362:0:15105:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.148@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788521916.323377:0:15105:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788521916.323403:0:15105:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788521916.814616:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788521917.395214:0:14423:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788521917.395226:0:14423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff996fb47cf000 from 7 10000000:01000000:0.0:1788521917.395233:0:14423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788521917.395291:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb4001a00/0x1b7b50db5927cddc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521917.395305:0:14423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996fb4001a00/0x1b7b50db5927cddc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521917.395320:0:14423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996fb4001a00/0x1b7b50db5927cddc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521917.395354:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f812ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816945152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788521917.395457:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521917.395531:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb7907180 going to sleep for 11 seconds 00000100:00100000:1.0:1788521917.397711:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816945152 00000100:00100000:1.0:1788521917.397727:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816945152 00000100:00100000:1.0:1788521917.397800:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788521917.397812:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+15:14423:x1875400816945152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521917.397831:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521917.397855:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996fbc6d4e00/0x1b7b50db5927cde3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927cddc expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521917.397901:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fbc6d4e00/0x1b7b50db5927cde3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927cddc expref: 16 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521917.397914:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996fbc6d4e00/0x1b7b50db5927cde3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927cddc expref: 16 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521917.397924:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d4e00, rc 0) 00000100:00100000:1.0:1788521917.398026:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+16:14423:x1875400816945152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 216us (2568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521917.398033:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788521917.400122:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f812ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816945152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521917.400176:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996fb4001a00/0x1b7b50db5927cddc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cde3 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521917.400192:0:14423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996fb4001a00/0x1b7b50db5927cddc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927cde3 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521917.400300:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f812ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816945280:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788521917.400376:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521917.400422:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb7907180 going to sleep for 11 seconds 00000100:00100000:2.0:1788521917.400518:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816945280 00000100:00100000:2.0:1788521917.400527:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816945280 00000100:00100000:2.0:1788521917.400588:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788521917.400599:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+16:14423:x1875400816945280:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788521917.400626:0:14419:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788521917.400646:0:14419:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788521917.400650:0:14419:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788521917.400770:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+16:14423:x1875400816945280:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 172us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521917.400779:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788521917.400799:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f812ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816945280:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788521917.400869:0:14423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788521917.400877:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb4001a00/0x1b7b50db5927cddc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cde3 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521917.400886:0:14423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996fb4001a00/0x1b7b50db5927cddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cde3 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521917.838459:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521918.862416:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521919.892618:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521920.910313:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788521921.358262:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788521921.358269:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788521921.358272:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788521921.358287:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788521921.358335:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f812e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816945536:0@lo:400:kworker.0 00000100:00100000:0.0:1788521921.358395:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521921.358444:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788521921.358450:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f812eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875400816945664:0@lo:400:kworker.0 00000100:00100000:0.0:1788521921.358471:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521921.358500:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816945536 00000100:00100000:0.0:1788521921.358507:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816945536 00000100:00100000:0.0:1788521921.358545:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816945664 00000100:00100000:0.0:1788521921.358547:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816945664 00000100:00100000:0.0:1788521921.358589:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521921.358597:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816945536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521921.358638:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816945536:12345-0@lo:400:kworker.0 Request processed in 42us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521921.358644:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521921.358658:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521921.358664:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875400816945664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521921.358686:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875400816945664:12345-0@lo:400:kworker.0 Request processed in 23us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521921.358691:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788521921.358727:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996f812eb100 x1875400816945664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521921.358740:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f812eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875400816945664:0@lo:400:kworker.0 00010000:00080000:0.0:1788521921.358751:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996f812e9c00 x1875400816945536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521921.358773:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f812e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816945536:0@lo:400:kworker.0 00000100:00100000:1.0:1788521921.359093:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f812ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1e22794d-c642-4031-a520-725ebfafbfe5:3307:1875400816945408:0@lo:400:kworker.0 00000100:00100000:1.0:1788521921.359128:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521921.359181:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816945408 00000100:00100000:1.0:1788521921.359185:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816945408 00000100:00100000:1.0:1788521921.359217:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788521921.359224:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+16:3307:x1875400816945408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521921.359320:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+16:3307:x1875400816945408:12345-0@lo:400:kworker.0 Request processed in 95us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521921.359337:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788521921.359374:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f812ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1e22794d-c642-4031-a520-725ebfafbfe5:3307:1875400816945408:0@lo:400:kworker.0 00000100:00080000:2.0:1788521921.359789:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788521921.934330:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788521922.293441:0:15473:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788521922.958491:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521923.982341:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521925.012249:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521926.032988:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788521926.418010:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1788521926.482653:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788521926.482660:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788521926.482663:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788521926.482667:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788521926.482714:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1e22794d-c642-4031-a520-725ebfafbfe5:3306:1875400816945792:0@lo:400:kworker.0 00000100:00100000:2.0:1788521926.482795:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521926.482849:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788521926.482863:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875400816945920:0@lo:400:kworker.0 00000100:00100000:2.0:1788521926.482893:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521926.482985:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816945920 00000100:00100000:3.0:1788521926.482994:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816945920 00000100:00100000:3.0:1788521926.483044:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788521926.483053:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad6fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875400816945920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521926.483108:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad6fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875400816945920:12345-0@lo:400:kworker.0 Request processed in 56us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521926.483115:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788521926.483189:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996fad6ff800 x1875400816945920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521926.483204:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875400816945920:0@lo:400:kworker.0 00000100:00100000:0.0:1788521926.484072:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875400816946048:0@lo:400:kworker.0 00000100:00100000:0.0:1788521926.484112:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521926.484173:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816945792 00000100:00100000:0.0:1788521926.484179:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816945792 00000100:00100000:0.0:1788521926.484217:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788521926.484225:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+16:3306:x1875400816945792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521926.484267:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+16:3306:x1875400816945792:12345-0@lo:400:kworker.0 Request processed in 43us (1473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521926.484274:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788521926.484605:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816946048 00000100:00100000:0.0:1788521926.484610:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816946048 00000100:00100000:0.0:1788521926.484646:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788521926.484653:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875400816946048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521926.484690:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875400816946048:12345-0@lo:400:kworker.0 Request processed in 38us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521926.484696:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788521926.484726:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1e22794d-c642-4031-a520-725ebfafbfe5:3306:1875400816945792:0@lo:400:kworker.0 00000100:00080000:0.0:1788521926.485058:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788521926.485084:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996fad6fed80 x1875400816946048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521926.485097:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875400816946048:0@lo:400:kworker.0 00010000:00010000:0.0:1788521927.057720:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521928.079453:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788521928.761428:0:15822:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788521928.761433:0:15822:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788521928.761546:0:15822:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff996fac9dc000 00000020:01000004:3.0:1788521928.761573:0:15822:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788521928.761585:0:15822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788521928.761613:0:15822:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff996fae918000) 00000020:00000080:3.0:1788521928.761631:0:15822:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788521928.783550:0:15822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788521928.784173:0:15822:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788521928.785357:0:15822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788521928.786714:0:15822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788521928.787426:0:15822:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788521928.788349:0:15822:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 367: rc = 0 00100000:10000000:0.0:1788521928.788491:0:15822:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 367: rc = 0 00100000:10000000:0.0:1788521928.788597:0:15822:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 367: rc = 0 00100000:10000000:0.0:1788521928.789038:0:15822:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 160: rc = 0 00100000:10000000:0.0:1788521928.789420:0:15822:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 160: rc = 0 00100000:10000000:0.0:1788521928.789652:0:15822:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 160: rc = 0 00100000:10000000:0.0:1788521928.789897:0:15822:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 160: rc = 0 00100000:10000000:0.0:1788521928.790137:0:15822:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 160: rc = 0 00100000:10000000:0.0:1788521928.790415:0:15822:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 160: rc = 0 00000020:00000080:0.0:1788521928.791739:0:15822:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788521928.791752:0:15822:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788521928.791762:0:15822:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1b7b50db5927cdf1 00000020:01000004:0.0:1788521928.791770:0:15822:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1788521928.791790:0:15822:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.148@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788521928.791794:0:15822:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788521928.791800:0:15822:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788521928.791820:0:15822:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1788521928.791823:0:15822:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.148@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788521928.803756:0:15822:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.148@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788521928.803793:0:15822:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.148@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788521928.803798:0:15822:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788521928.803799:0:15822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788521928.803800:0:15822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788521928.803801:0:15822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788521928.803803:0:15822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788521928.803804:0:15822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788521928.803805:0:15822:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788521928.803811:0:15822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788521928.803812:0:15822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788521928.803815:0:15822:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788521928.803817:0:15822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788521928.803818:0:15822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788521928.803818:0:15822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788521928.803819:0:15822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788521928.803820:0:15822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788521928.803821:0:15822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788521928.803822:0:15822:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788521928.803823:0:15822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788521928.803824:0:15822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788521928.804021:0:15822:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788521928.804356:0:15822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f812eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816946176:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788521928.804521:0:15822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521928.804631:0:15822:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f84eb0540 going to sleep for 11 seconds 00000100:00100000:2.0:1788521928.804735:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816946176 00000100:00100000:2.0:1788521928.804743:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816946176 00000100:00100000:2.0:1788521928.804838:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788521928.804861:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+16:15822:x1875400816946176:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788521928.804901:0:14419:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788521928.804904:0:14419:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788521928.804908:0:14419:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788521928.812503:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+16:15822:x1875400816946176:12345-0@lo:253:mount.lustre.0 Request processed in 7636us (7973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521928.812516:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788521928.812638:0:15822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f812eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816946176:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788521928.812653:0:15822:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788521928.812656:0:15822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788521928.812658:0:15822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788521928.812659:0:15822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788521928.812660:0:15822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788521928.812661:0:15822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788521928.812663:0:15822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788521928.812664:0:15822:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788521928.812665:0:15822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788521928.812666:0:15822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788521928.812684:0:15822:0:(tgt_mount.c:101:server_register_mount()) register mount ffff996fac9dc000 from lustre-OST0001 10000000:01000000:1.0:1788521928.812707:0:15822:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788521928.812709:0:15822:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788521928.812716:0:15822:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff996fbc57cd40 local copy 00010000:00010000:1.0:1788521928.812725:0:15822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490b800/0x1b7b50db5927cc62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cc69 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521928.813373:0:15822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d36300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816946304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788521928.813407:0:15822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521928.813474:0:15822:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fbc3d6600 going to sleep for 11 seconds 00000100:00100000:0.0:1788521928.813512:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816946304 00000100:00100000:0.0:1788521928.813519:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816946304 00000100:00100000:0.0:1788521928.813639:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788521928.813648:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+16:15822:x1875400816946304:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788521928.813833:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+16:15822:x1875400816946304:12345-0@lo:501:mount.lustre.0 Request processed in 186us (425us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788521928.813840:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788521928.813934:0:15822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d36300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816946304:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788521928.813949:0:15822:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788521928.814122:0:15822:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788521928.814130:0:15822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490b800/0x1b7b50db5927cc62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cc69 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521928.814139:0:15822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996fb490b800/0x1b7b50db5927cc62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cc69 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521928.814185:0:15822:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff996fac9dc000 10000000:01000000:2.0:1788521928.814190:0:15822:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788521928.814195:0:15822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788521928.814197:0:15822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788521928.814208:0:15822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788521928.814211:0:15822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788521928.814234:0:15822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490b000/0x1b7b50db5927cdf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521928.814241:0:15822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996fb490b000/0x1b7b50db5927cdf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521928.814249:0:15822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996fb490b000/0x1b7b50db5927cdf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521928.814262:0:15822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816946432:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788521928.814289:0:15822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521928.814710:0:15822:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f98b84480 going to sleep for 11 seconds 00000100:00100000:1.0:1788521928.814808:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816946432 00000100:00100000:1.0:1788521928.814814:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816946432 00000100:00100000:1.0:1788521928.814851:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788521928.814858:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+16:15822:x1875400816946432:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788521928.814875:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521928.814895:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996fbc6d5600/0x1b7b50db5927cdff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927cdf8 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521928.814926:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fbc6d5600/0x1b7b50db5927cdff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927cdf8 expref: 17 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521928.814937:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996fbc6d5600/0x1b7b50db5927cdff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927cdf8 expref: 17 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521928.814946:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d5600, rc 0) 00000100:00100000:1.0:1788521928.814989:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+17:15822:x1875400816946432:12345-0@lo:101:mount.lustre.0 Request processed in 131us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521928.814995:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788521928.815288:0:15822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816946432:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521928.815302:0:15822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996fb490b000/0x1b7b50db5927cdf8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cdff expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521928.815311:0:15822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996fb490b000/0x1b7b50db5927cdf8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927cdff expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788521928.815929:0:15822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788521928.816716:0:15822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788521928.816948:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788521928.816991:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788521928.817019:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788521928.817058:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788521928.817088:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788521928.817114:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788521928.817213:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788521928.817229:0:15822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788521928.817300:0:15822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816946560:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521928.817354:0:15822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521928.817385:0:15822:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f98b84600 going to sleep for 11 seconds 00000100:00100000:1.0:1788521928.817542:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816946560 00000100:00100000:1.0:1788521928.817548:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816946560 00000100:00100000:1.0:1788521928.817579:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788521928.817588:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+17:15822:x1875400816946560:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788521928.817978:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+17:15822:x1875400816946560:12345-0@lo:501:mount.lustre.0 Request processed in 391us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521928.817986:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788521928.818438:0:15822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816946560:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521928.818483:0:15822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816946688:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788521928.818527:0:15822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521928.818611:0:15822:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f98b84600 going to sleep for 11 seconds 00000100:00100000:0.0:1788521928.818729:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816946688 00000100:00100000:0.0:1788521928.818735:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816946688 00000100:00100000:3.0:1788521928.818817:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788521928.818829:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+17:15822:x1875400816946688:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788521928.819187:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+17:15822:x1875400816946688:12345-0@lo:503:mount.lustre.0 Request processed in 360us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521928.819201:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788521928.819286:0:15822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816946688:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788521928.820209:0:15822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788521928.820277:0:15822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816946816:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788521928.820325:0:15822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521928.820362:0:15822:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f98b84600 going to sleep for 11 seconds 00000100:00100000:1.0:1788521928.820589:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816946816 00000100:00100000:1.0:1788521928.820595:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816946816 00000100:00100000:1.0:1788521928.820624:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788521928.820631:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+17:15822:x1875400816946816:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788521928.820828:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+17:15822:x1875400816946816:12345-0@lo:502:mount.lustre.0 Request processed in 196us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521928.820854:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788521928.821100:0:15822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816946816:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788521928.821360:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788521928.821409:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788521928.821439:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788521928.821480:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788521928.821512:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788521928.821540:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788521928.821598:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788521928.821631:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788521928.821672:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1788521928.821699:0:15822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816946944:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788521928.821737:0:15822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521928.821761:0:15822:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f98b84600 going to sleep for 11 seconds 00000100:00100000:1.0:1788521928.822052:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816946944 00000100:00100000:1.0:1788521928.822058:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816946944 00000100:00100000:1.0:1788521928.822085:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788521928.822102:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+17:15822:x1875400816946944:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788521928.822267:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+17:15822:x1875400816946944:12345-0@lo:502:mount.lustre.0 Request processed in 164us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521928.822274:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788521928.822400:0:15822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816946944:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788521928.822466:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1788521928.822476:0:15822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1788521928.823528:0:15823:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788521928.823536:0:15823:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788521928.823542:0:15823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521928.823544:0:15823:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788521928.823549:0:15823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788521928.823692:0:15823:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff996fb47d8000) 00000020:00000080:0.0:1788521928.823712:0:15823:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788521928.823719:0:15823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788521928.823777:0:15823:0:(tgt_mount.c:153:server_get_mount()) get mount ffff996fac9dc000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788521928.823784:0:15823:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788521928.823796:0:15823:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1b7b50db5927ce0d 00010000:00010000:0.0:1788521928.830188:0:15823:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1788521928.830795:0:15823:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1788521928.833379:0:15823:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788521928.835305:0:15823:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788521928.835315:0:15823:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521928.835321:0:15823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521928.835323:0:15823:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788521928.835326:0:15823:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521928.835329:0:15823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521928.835331:0:15823:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788521928.835334:0:15823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788521928.835335:0:15823:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788521928.835338:0:15823:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521928.835340:0:15823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521928.835342:0:15823:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788521928.835344:0:15823:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521928.835346:0:15823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521928.835347:0:15823:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788521928.835350:0:15823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788521928.835403:0:15823:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521928.835409:0:15823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521928.835411:0:15823:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788521928.835416:0:15823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788521928.839907:0:15822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788521928.839960:0:15822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788521928.839987:0:15822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490b000/0x1b7b50db5927cdf8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cdff expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521928.839998:0:15822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996fb490b000/0x1b7b50db5927cdf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cdff expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521928.840023:0:15822:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff996fac9dc000 from 1 10000000:01000000:2.0:1788521928.840026:0:15822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788521928.840061:0:15822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490bc00/0x1b7b50db5927ce14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521928.840070:0:15822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996fb490bc00/0x1b7b50db5927ce14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521928.840079:0:15822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996fb490bc00/0x1b7b50db5927ce14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521928.840113:0:15822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816947072:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788521928.840199:0:15822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521928.840234:0:15822:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f98b84600 going to sleep for 11 seconds 00000100:00100000:3.0:1788521928.840499:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816947072 00000100:00100000:3.0:1788521928.840507:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816947072 00000100:00100000:3.0:1788521928.840559:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788521928.840568:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+17:15822:x1875400816947072:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788521928.840579:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521928.840591:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f8392de00/0x1b7b50db5927ce1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927ce14 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521928.840612:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8392de00/0x1b7b50db5927ce1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927ce14 expref: 18 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521928.840624:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f8392de00/0x1b7b50db5927ce1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927ce14 expref: 18 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521928.840632:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392de00, rc 0) 00000100:00100000:3.0:1788521928.840666:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+18:15822:x1875400816947072:12345-0@lo:101:mount.lustre.0 Request processed in 99us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521928.840673:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788521928.841020:0:15822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816947072:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521928.841034:0:15822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996fb490bc00/0x1b7b50db5927ce14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927ce1b expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521928.841058:0:15822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996fb490bc00/0x1b7b50db5927ce14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927ce1b expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788521928.841708:0:15822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788521928.842314:0:15822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788521928.842546:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788521928.842654:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788521928.842715:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788521928.842724:0:15822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788521928.842785:0:15822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816947200:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521928.842831:0:15822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521928.843032:0:15822:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f98b84600 going to sleep for 11 seconds 00000100:00100000:3.0:1788521928.845015:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816947200 00000100:00100000:3.0:1788521928.845026:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816947200 00000100:00100000:3.0:1788521928.845123:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788521928.845133:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+18:15822:x1875400816947200:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788521928.845442:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+18:15822:x1875400816947200:12345-0@lo:501:mount.lustre.0 Request processed in 310us (2610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521928.845450:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788521928.845539:0:15822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816947200:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521928.845600:0:15822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816947328:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788521928.845643:0:15822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521928.854437:0:15822:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f98b84600 going to sleep for 11 seconds 00000100:00100000:0.0:1788521928.855662:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816947328 00000100:00100000:0.0:1788521928.855673:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816947328 00000100:00100000:0.0:1788521928.855731:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788521928.855740:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+18:15822:x1875400816947328:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788521928.856355:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+18:15822:x1875400816947328:12345-0@lo:503:mount.lustre.0 Request processed in 615us (10710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521928.856364:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788521928.856499:0:15822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816947328:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788521928.857366:0:15822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788521928.857439:0:15822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816947456:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788521928.857497:0:15822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521928.857531:0:15822:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f98b84600 going to sleep for 11 seconds 00000100:00100000:3.0:1788521928.860459:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816947456 00000100:00100000:3.0:1788521928.860490:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816947456 00000100:00100000:3.0:1788521928.860543:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788521928.860552:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+18:15822:x1875400816947456:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788521928.861193:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+18:15822:x1875400816947456:12345-0@lo:502:mount.lustre.0 Request processed in 640us (3695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521928.861201:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788521928.861448:0:15822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816947456:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788521928.861774:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788521928.861829:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788521928.861909:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788521928.862350:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788521928.862388:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788521928.862442:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788521928.862481:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788521928.862515:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788521928.862568:0:15822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816947584:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788521928.862627:0:15822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521928.862671:0:15822:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f98b84600 going to sleep for 11 seconds 00000100:00100000:1.0:1788521928.863002:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816947584 00000100:00100000:1.0:1788521928.863010:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816947584 00000100:00100000:1.0:1788521928.863048:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788521928.863055:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+18:15822:x1875400816947584:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788521928.863313:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+18:15822:x1875400816947584:12345-0@lo:502:mount.lustre.0 Request processed in 257us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521928.863323:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788521928.863523:0:15822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816947584:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788521928.863826:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788521928.863838:0:15822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788521928.867374:0:15827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521928.867399:0:15827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521928.867402:0:15827:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788521928.867408:0:15827:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff996fac9dc000 00000020:00000080:0.0:1788521928.867411:0:15827:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788521928.867417:0:15827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521928.867420:0:15827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521928.867421:0:15827:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788521928.867423:0:15827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521928.867425:0:15827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521928.867426:0:15827:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788521928.867430:0:15827:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff996fac9dc000 00000020:00000080:0.0:1788521928.867432:0:15827:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788521928.867561:0:15827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521928.867567:0:15827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521928.867568:0:15827:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788521928.867570:0:15827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521928.867573:0:15827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521928.867574:0:15827:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788521928.867577:0:15827:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff996fac9dc000 00000020:00000080:0.0:1788521928.867579:0:15827:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788521928.870243:0:15827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521928.870253:0:15827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521928.870256:0:15827:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788521928.870260:0:15827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788521928.874867:0:15822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788521928.875248:0:15822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788521928.875274:0:15822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490bc00/0x1b7b50db5927ce14 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927ce1b expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521928.875288:0:15822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996fb490bc00/0x1b7b50db5927ce14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927ce1b expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521928.875348:0:15822:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788521928.875354:0:15822:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff996fac9dc000 10000000:01000000:2.0:1788521928.875357:0:15822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff996fac9dc000 10000000:01000000:2.0:1788521928.875360:0:15822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788521928.875368:0:15822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff996fac9dc000 from 1 10000000:01000000:2.0:1788521928.875371:0:15822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788521928.875409:0:15822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490a000/0x1b7b50db5927ce22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521928.875420:0:15822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996fb490a000/0x1b7b50db5927ce22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521928.875447:0:15822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996fb490a000/0x1b7b50db5927ce22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521928.875475:0:15822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816947712:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788521928.875548:0:15822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521928.875589:0:15822:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f98b84d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521928.875656:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816947712 00000100:00100000:3.0:1788521928.875666:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816947712 00000100:00100000:3.0:1788521928.875713:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788521928.875727:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+18:15822:x1875400816947712:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788521928.875740:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521928.875753:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f8392d400/0x1b7b50db5927ce29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927ce22 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521928.875777:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f8392d400/0x1b7b50db5927ce29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927ce22 expref: 19 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521928.875787:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f8392d400/0x1b7b50db5927ce29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927ce22 expref: 19 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521928.875796:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f8392d400, rc 0) 00000100:00100000:3.0:1788521928.875834:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+19:15822:x1875400816947712:12345-0@lo:101:mount.lustre.0 Request processed in 109us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521928.875841:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788521928.876210:0:15822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816947712:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521928.876225:0:15822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996fb490a000/0x1b7b50db5927ce22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927ce29 expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521928.876234:0:15822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996fb490a000/0x1b7b50db5927ce22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927ce29 expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788521928.879369:0:15822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788521928.879717:0:15822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788521928.884027:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788521928.884205:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788521928.884246:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788521928.884296:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788521928.884335:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788521928.884414:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788521928.884455:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788521928.884490:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788521928.884539:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788521928.884575:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788521928.884610:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788521928.884657:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788521928.888255:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788521928.888324:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788521928.888419:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788521928.888458:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788521928.888493:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788521928.888543:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788521928.888580:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788521928.888614:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788521928.888663:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788521928.888702:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788521928.888737:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788521928.888797:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788521928.888838:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788521928.888966:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788521928.889020:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788521928.889059:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788521928.889093:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788521928.889163:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1788521928.889215:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1788521928.889253:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1788521928.889289:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1788521928.889340:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1788521928.889378:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1788521928.889427:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1788521928.889464:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1788521928.889559:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1788521928.889567:0:15822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788521928.889663:0:15822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816947840:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521928.889724:0:15822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521928.889776:0:15822:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f98b84d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521928.890605:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816947840 00000100:00100000:3.0:1788521928.890615:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816947840 00000100:00100000:3.0:1788521928.890660:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788521928.890668:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+19:15822:x1875400816947840:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788521928.890935:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+19:15822:x1875400816947840:12345-0@lo:501:mount.lustre.0 Request processed in 267us (1210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521928.890943:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788521928.892699:0:15822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816947840:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521928.892748:0:15822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816947968:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788521928.892802:0:15822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521928.892831:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816947968 00000100:00100000:2.0:1788521928.892836:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816947968 00000100:00100000:2.0:1788521928.894166:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788521928.894176:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+19:15822:x1875400816947968:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788521928.894433:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+19:15822:x1875400816947968:12345-0@lo:503:mount.lustre.0 Request processed in 258us (1630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521928.894441:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788521928.894488:0:15822:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f98b84d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521928.894506:0:15822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816947968:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788521928.895011:0:15822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788521928.897527:0:15822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816948096:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788521928.897602:0:15822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521928.897650:0:15822:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f98b84d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521928.897733:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816948096 00000100:00100000:0.0:1788521928.897741:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816948096 00000100:00100000:0.0:1788521928.897794:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788521928.897804:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5facc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+19:15822:x1875400816948096:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788521928.899010:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5facc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+19:15822:x1875400816948096:12345-0@lo:502:mount.lustre.0 Request processed in 1204us (1404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521928.899020:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788521928.899809:0:15822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816948096:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788521928.900134:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788521928.900210:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788521928.900240:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788521928.900289:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788521928.900328:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788521928.900385:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788521928.900420:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788521928.900452:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788521928.900495:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788521928.900531:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788521928.900562:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788521928.900611:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788521928.900659:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788521928.900690:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788521928.900745:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788521928.900781:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788521928.900809:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788521928.900852:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788521928.900898:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788521928.900934:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788521928.900996:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788521928.901048:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788521928.901086:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788521928.901138:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788521928.901200:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788521928.901237:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788521928.901288:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788521928.901326:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788521928.901361:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788521928.901408:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788521928.901445:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788521928.901478:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788521928.901510:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788521928.901559:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788521928.901598:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788521928.901647:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788521928.901685:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788521928.901735:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788521928.901784:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788521928.901818:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788521928.901860:0:15822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816948224:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788521928.901939:0:15822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521928.901987:0:15822:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f98b84d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521928.901999:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816948224 00000100:00100000:1.0:1788521928.902006:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816948224 00000100:00100000:1.0:1788521928.902123:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788521928.902133:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5faf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+19:15822:x1875400816948224:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788521928.902385:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5faf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+19:15822:x1875400816948224:12345-0@lo:502:mount.lustre.0 Request processed in 251us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521928.902392:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788521928.905829:0:15822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816948224:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788521928.905990:0:15822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788521928.906005:0:15822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788521928.909185:0:15832:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788521928.909200:0:15832:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff996faed5cd40) 00000020:00000080:2.0:1788521928.909220:0:15832:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1788521928.909287:0:15832:0:(tgt_mount.c:153:server_get_mount()) get mount ffff996fac9dc000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788521928.909292:0:15832:0:(tgt_mount.c:187:server_put_mount()) put mount ffff996fac9dc000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788521928.909294:0:15832:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996fac9dc000 3 00010000:00080000:2.0:1788521928.909324:0:15832:0:(ldlm_lib.c:102:import_set_conn()) imp ffff996f87cac000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.148@tcp at head 00010000:00010000:2.0:1788521928.910922:0:15832:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1788521928.911099:0:15832:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788521928.911128:0:15832:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788521928.911138:0:15832:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x1b7b50db5927ce37 00000100:00080000:2.0:1788521928.911173:0:15832:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788521928.911179:0:15832:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff996f87cac000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1788521928.911224:0:15832:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996fad6fdf80 x1875400816948352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788521928.911248:0:15832:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788521928.911684:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875400816948352:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788521928.911752:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788521928.911805:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788521928.911810:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788521928.911812:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788521928.911815:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788521928.911861:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788521928.911870:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875400816948608:0@lo:400:kworker.0 00000100:00100000:0.0:1788521928.912139:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875400816948480:0@lo:400:kworker.0 00000100:00100000:0.0:1788521928.912199:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521928.912245:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816948352 00000100:00100000:0.0:1788521928.912252:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816948352 00000100:00100000:0.0:1788521928.912281:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816948480 00000100:00100000:0.0:1788521928.912284:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816948480 00000100:00100000:0.0:1788521928.912305:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788521928.912312:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875400816948480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521928.912354:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875400816948480:12345-0@lo:400:kworker.0 Request processed in 41us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521928.912361:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788521928.915326:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521928.915336:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1875400816948352:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788521928.915367:0:14427:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 428 last 0 00000020:00000080:0.0:1788521928.915408:0:14427:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1b7b50db5927ce3e 00000004:00100000:0.0:1788521928.915424:0:14427:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788521928.915456:0:14427:0:(import.c:65:import_set_state_nolock()) ffff996f9816d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788521928.915536:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875400816948352:12345-0@lo:38:llog_process_th.0 Request processed in 198us (3783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521928.915544:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788521928.915616:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996f860d9500 x1875400816948480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521928.915630:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875400816948480:0@lo:400:kworker.0 00010000:00080000:0.0:1788521928.915678:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996fad6fdf80 x1875400816948352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788521938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521928.915686:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788521928.915706:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788521928.915714:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788521928.915718:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788521928.915721:0:3303:0:(import.c:65:import_set_state_nolock()) ffff996f87cac000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788521928.915726:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875400816948352:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788521928.918872:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521928.919437:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816948608 00000100:00100000:2.0:1788521928.919446:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816948608 00000100:00100000:2.0:1788521928.919494:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788521928.919502:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875400816948608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521928.919561:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875400816948608:12345-0@lo:400:kworker.0 Request processed in 60us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521928.919568:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000040:00080000:2.0:1788521928.919829:0:15832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00080000:0.0:1788521928.921239:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:2.0:1788521928.921628:0:15822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788521928.921665:0:15822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788521928.921703:0:15822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb490a000/0x1b7b50db5927ce22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927ce29 expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521928.921715:0:15822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996fb490a000/0x1b7b50db5927ce22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927ce29 expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788521928.921764:0:15822:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788521928.921766:0:15822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788521928.921767:0:15822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521928.921768:0:15822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521928.921770:0:15822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521928.921771:0:15822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521928.921773:0:15822:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788521928.921775:0:15822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521928.921776:0:15822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788521928.921779:0:15822:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788521928.921782:0:15822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788521928.921783:0:15822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788521928.921784:0:15822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521928.921785:0:15822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521928.921786:0:15822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521928.921787:0:15822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521928.921788:0:15822:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788521928.921789:0:15822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521928.921790:0:15822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788521928.921815:0:15822:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788521928.921834:0:15822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816948736:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788521928.921927:0:15822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521928.921970:0:15822:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f98b84600 going to sleep for 11 seconds 00000100:00100000:0.0:1788521928.922004:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816948736 00000100:00100000:0.0:1788521928.922010:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816948736 00000100:00100000:0.0:1788521928.922064:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788521928.922074:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+19:15822:x1875400816948736:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788521928.922098:0:14419:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788521928.922111:0:14419:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1788521928.922646:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996f860d8e00 x1875400816948608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521928.922661:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875400816948608:0@lo:400:kworker.0 20000000:01000000:1.0:1788521928.963510:0:14419:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788521928.963528:0:14419:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788521928.963679:0:14441:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788521928.963684:0:14441:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788521928.963705:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996fb4001200/0x1b7b50db5927ce45 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521928.963722:0:14441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996fbc6d4e00/0x1b7b50db5927cde3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927cddc expref: 19 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521928.963731:0:14441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996fb4001200/0x1b7b50db5927ce45 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521928.963770:0:14441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996fbc6d4e00/0x1b7b50db5927cde3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927cddc expref: 19 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521928.963790:0:14441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996fbc6d4e00/0x1b7b50db5927cde3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927cddc expref: 19 pid: 14420 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521928.963804:0:14441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f812ebb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14441:1875400816948864:0@lo:104: 00000100:00100000:0.0:1788521928.963876:0:14441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521928.963934:0:14441:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90f5a180 going to sleep for 11 seconds 00000100:00100000:1.0:1788521928.964040:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816948864 00000100:00100000:1.0:1788521928.964048:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816948864 00000100:00100000:1.0:1788521928.964104:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788521928.964113:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1e22794d-c642-4031-a520-725ebfafbfe5+3:14441:x1875400816948864:12345-0@lo:104: 00010000:00010000:1.0:1788521928.964125:0:14409:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996fb4001a00/0x1b7b50db5927cddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927cde3 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521928.964193:0:14409:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788521928.964199:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1e22794d-c642-4031-a520-725ebfafbfe5+3:14441:x1875400816948864:12345-0@lo:104: Request processed in 88us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521928.964206:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788521928.964320:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521928.964326:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996fb4001a00/0x1b7b50db5927cddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927cde3 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521928.964333:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4001a00 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:0.0:1788521928.964336:0:14414:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996fb4001a00/0x1b7b50db5927cddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927cde3 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521928.964345:0:14414:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996fb4001a00/0x1b7b50db5927cddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927cde3 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521928.964352:0:14414:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996fb4001a00/0x1b7b50db5927cddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927cde3 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521928.964358:0:14414:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521928.964390:0:14414:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996fb4001a00/0x1b7b50db5927cddc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927cde3 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521928.964397:0:14414:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521928.964416:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996fb4001a00/0x1b7b50db5927cddc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927cde3 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521928.964423:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996fb4001a00/0x1b7b50db5927cddc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927cde3 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521928.964436:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521928.964438:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521928.964440:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521928.964451:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f812ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1e22794d-c642-4031-a520-725ebfafbfe5:3307:1875400816948992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521928.964485:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521928.964527:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816948992 00000100:00100000:0.0:1788521928.964530:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816948992 00010000:00010000:0.0:1788521928.964548:0:14410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996fbc6d4e00/0x1b7b50db5927cde3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927cddc expref: 20 pid: 14420 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521928.964581:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521928.964590:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e22794d-c642-4031-a520-725ebfafbfe5+20:3307:x1875400816948992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521928.964599:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521928.964604:0:14410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996fbc6d4e00/0x1b7b50db5927cde3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927cddc expref: 20 pid: 14420 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521928.964616:0:14410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996fbc6d4e00/0x1b7b50db5927cde3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927cddc expref: 20 pid: 14420 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521928.964631:0:14410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996fb4001200/0x1b7b50db5927ce45 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521928.964639:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fb4001200/0x1b7b50db5927ce45 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788521928.964651:0:14410:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001960139s 00010000:00010000:0.0:1788521928.964656:0:14410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996fb4001200/0x1b7b50db5927ce45 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521928.964662:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996fb4001200/0x1b7b50db5927ce45 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521928.964668:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996fb4001200/0x1b7b50db5927ce45 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521928.964683:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996fb4001200/0x1b7b50db5927ce45 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521928.964689:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4001200 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521928.964692:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996fb4001200/0x1b7b50db5927ce45 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521928.964699:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996fb4001200/0x1b7b50db5927ce45 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521928.964707:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996fb4001200/0x1b7b50db5927ce45 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521928.964716:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521928.964744:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e22794d-c642-4031-a520-725ebfafbfe5+20:3307:x1875400816948992:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521928.964750:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521928.964785:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f812ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1e22794d-c642-4031-a520-725ebfafbfe5:3307:1875400816948992:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521928.964809:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996fbc6d4e00/0x1b7b50db5927cde3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927cddc expref: 19 pid: 14420 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521928.964818:0:14441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f812ebb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14441:1875400816948864:0@lo:104: 00010000:00010000:0.0:1788521928.964827:0:14441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996fb4001200/0x1b7b50db5927ce45 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521928.964834:0:14441:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996fb4001200/0x1b7b50db5927ce45 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521928.964850:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996fb4001200/0x1b7b50db5927ce45 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521928.964857:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996fb4001200/0x1b7b50db5927ce45 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521928.974596:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+18:15822:x1875400816948736:12345-0@lo:253:mount.lustre.0 Request processed in 52516us (52661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521928.974610:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788521928.974765:0:15822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1e22794d-c642-4031-a520-725ebfafbfe5:15822:1875400816948736:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788521928.974780:0:15822:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788521928.974783:0:15822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788521928.974784:0:15822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788521928.974786:0:15822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521928.974787:0:15822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521928.974801:0:15822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521928.974802:0:15822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521928.974803:0:15822:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788521928.974805:0:15822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521928.974806:0:15822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788521928.974824:0:15822:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788521928.979536:0:15822:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788521928.979787:0:15822:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788521928.979964:0:15822:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788521928.980126:0:15822:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788521928.980284:0:15822:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788521928.980475:0:15822:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788521928.982777:0:15822:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788521929.065723:0:15822:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788521929.065732:0:15822:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788521929.065760:0:15822:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788521929.065984:0:15822:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.148@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788521929.066001:0:15822:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788521929.066085:0:15822:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788521929.110434:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521929.941609:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788521914/real 1788521914] req@ffff996f812e9880 x1875400816941952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521929 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521929.941639:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff996f812e9880 x1875400816941952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521929 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521929.941649:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788521914/real 1788521914] req@ffff996f812eb800 x1875400816941824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521929 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521929.941671:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff996f812eb800 x1875400816941824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521929 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788521929.941690:0:3303:0:(import.c:65:import_set_state_nolock()) ffff996fbc6b2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788521929.941712:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788521929.941716:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f812e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875400816941952:0@lo:8:kworker.0 00000100:00080000:3.0:1788521929.941723:0:3303:0:(import.c:65:import_set_state_nolock()) ffff996f851a3800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788521929.941728:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788521929.941731:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f812eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875400816941824:0@lo:8:kworker.0 00000100:00080000:3.0:1788521929.941805:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788521929.941810:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788521929.941812:0:37:0:(import.c:65:import_set_state_nolock()) ffff996f851a3800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788521929.941817:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 414 00000100:00080000:3.0:1788521929.941823:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788521929.941830:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff996f851a3800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1788521929.941848:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996f860d8000 x1875400816949248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788521929.941862:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788521929.941865:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788521929.941867:0:37:0:(import.c:65:import_set_state_nolock()) ffff996fbc6b2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788521929.941870:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 414 00000100:00080000:3.0:1788521929.941873:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788521929.941887:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff996fbc6b2800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1788521929.941899:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996f860da300 x1875400816949376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788521929.941974:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1e22794d-c642-4031-a520-725ebfafbfe5:3304:1875400816949120:0@lo:400:kworker.0 00000100:00100000:3.0:1788521929.942030:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521929.942075:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788521929.942082:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816949504:0@lo:400:kworker.0 00000100:00100000:3.0:1788521929.942122:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521929.942175:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875400816949632:0@lo:400:kworker.0 00000100:00100000:3.0:1788521929.942199:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521929.942217:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788521929.942222:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875400816949760:0@lo:400:kworker.0 00000100:00100000:3.0:1788521929.942242:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521929.942269:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816949120 00000100:00100000:3.0:1788521929.942276:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816949120 00000100:00100000:3.0:1788521929.942323:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788521929.942332:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+18:3304:x1875400816949120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521929.942374:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+18:3304:x1875400816949120:12345-0@lo:400:kworker.0 Request processed in 43us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521929.942381:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788521929.942429:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816949504 00000100:00100000:3.0:1788521929.942433:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816949504 00000100:00100000:3.0:1788521929.942452:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816949632 00000100:00100000:3.0:1788521929.942454:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816949632 00000100:00100000:3.0:1788521929.942465:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816949760 00000100:00100000:3.0:1788521929.942468:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816949760 00000100:00100000:3.0:1788521929.942825:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788521929.942834:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816949504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521929.942867:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875400816949504:12345-0@lo:400:kworker.0 Request processed in 36us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521929.942891:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788521929.942904:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788521929.942910:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875400816949632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521929.942941:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875400816949632:12345-0@lo:400:kworker.0 Request processed in 31us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521929.942948:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788521929.942960:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788521929.942966:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875400816949760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521929.942990:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875400816949760:12345-0@lo:400:kworker.0 Request processed in 25us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521929.942996:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788521929.943017:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788521929.943393:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996f860dbb80 x1875400816949760/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521929.943406:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875400816949760:0@lo:400:kworker.0 00010000:00080000:3.0:1788521929.943417:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996f860d8700 x1875400816949632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521929.943425:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875400816949632:0@lo:400:kworker.0 00000100:00100000:3.0:1788521929.943453:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875400816949248:0@lo:8:kworker.0 00000100:00100000:3.0:1788521929.943482:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521929.943581:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875400816949376:0@lo:8:kworker.0 00000100:00100000:3.0:1788521929.943604:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788521929.943645:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996f860db100 x1875400816949504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521929.943662:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875400816949504:0@lo:400:kworker.0 00000100:00100000:3.0:1788521929.943674:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1e22794d-c642-4031-a520-725ebfafbfe5:3304:1875400816949120:0@lo:400:kworker.0 00000100:00100000:2.0:1788521929.943775:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816949248 00000100:00100000:2.0:1788521929.943781:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816949248 00000100:00100000:2.0:1788521929.943804:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816949376 00000100:00100000:2.0:1788521929.943807:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816949376 00000100:00100000:2.0:1788521929.943816:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788521929.943820:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875400816949248:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788521929.943839:0:15106:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 429 last 0 00000020:00000080:2.0:1788521929.943863:0:15106:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b7b50db5927ce4c 00002000:00100000:2.0:1788521929.943875:0:15106:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff996f85d83000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788521929.943890:0:15106:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788521929.943892:0:15106:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788521929.944352:0:15106:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788521929.944381:0:15106:0:(import.c:65:import_set_state_nolock()) ffff996f85d82800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788521929.944424:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875400816949248:12345-0@lo:8:kworker.0 Request processed in 601us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521929.944431:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788521929.944447:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788521929.944452:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875400816949376:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788521929.944467:0:15106:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 429 last 0 00000020:00000080:2.0:1788521929.944482:0:15106:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b7b50db5927ce53 00002000:00100000:2.0:1788521929.945303:0:15106:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff996f85d87000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788521929.945309:0:15106:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788521929.945312:0:15106:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:3.0:1788521929.945676:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996f860d8000 x1875400816949248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788521949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521929.945710:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788521929.945718:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788521929.945725:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788521929.945730:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788521929.945732:0:3303:0:(import.c:65:import_set_state_nolock()) ffff996f851a3800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788521929.945765:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788521929.945771:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875400816949248:0@lo:8:kworker.0 00000004:00080000:3.0:1788521929.945795:0:14447:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788521929.946680:0:14447:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 429931536344ns, next at 0ns, rc = 0 00002000:00080000:2.0:1788521929.947016:0:15106:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788521929.947042:0:15106:0:(import.c:65:import_set_state_nolock()) ffff996f913e3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788521929.948262:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875400816949376:12345-0@lo:8:kworker.0 Request processed in 3803us (4651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521929.948273:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788521929.949377:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996f860da300 x1875400816949376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788521949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521929.949389:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788521929.949398:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788521929.949405:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788521929.949409:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788521929.949412:0:3303:0:(import.c:65:import_set_state_nolock()) ffff996fbc6b2800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788521929.949430:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788521929.949436:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875400816949376:0@lo:8:kworker.0 00000004:00080000:2.0:1788521929.949652:0:14449:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788521929.949891:0:14448:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:0.0:1788521929.949913:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f812ead80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14448:1875400816950144:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788521929.949962:0:14448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521929.949983:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90f5a9c0 going to sleep for 11 seconds 00000004:00080000:3.0:1788521929.950855:0:14450:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1788521929.950875:0:14450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14450:1875400816950272:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788521929.950920:0:14450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521929.950938:0:14450:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f983fd780 going to sleep for 11 seconds 00000100:00100000:3.0:1788521929.950964:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816950144 00000100:00100000:3.0:1788521929.950969:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816950144 00000100:00100000:3.0:1788521929.951008:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816950272 00000100:00100000:3.0:1788521929.951011:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816950272 00000100:00100000:3.0:1788521929.951029:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788521929.951037:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14448:x1875400816950144:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788521929.951284:0:14449:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 429936140296ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788521929.956226:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f812ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816950016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521929.956293:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521929.956331:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788521929.956338:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816949888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521929.956361:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521929.958896:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816950016 00000100:00100000:1.0:1788521929.958908:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816950016 00000100:00100000:1.0:1788521929.958939:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816949888 00000100:00100000:1.0:1788521929.958942:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816949888 00000100:00100000:1.0:1788521929.958960:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788521929.958969:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad6fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875400816950016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788521929.959001:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521929.959071:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad6fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875400816950016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (2777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521929.959077:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788521929.959854:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788521929.959863:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad6fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875400816949888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521929.959887:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521929.959923:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad6fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875400816949888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (3561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521929.959930:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788521929.960174:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996f860da300 x1875400816949888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521929.960206:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816949888:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788521929.960226:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996f812ebb80 x1875400816950016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521929.960238:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f812ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816950016:0@lo:13:osp-pre-0-0.0 00002000:00080000:3.0:1788521929.962225:0:15107:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788521929.962236:0:15107:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788521929.962242:0:15107:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000100:00080000:2.0:1788521929.963246:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521929.963251:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1788521929.975756:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521929.975767:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddf93e8c/0x1b7b50db5927ce5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.975784:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788521929.975789:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521929.975795:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddf93e8c/0x1b7b50db5927ce5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.975812:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddf93e8c/0x1b7b50db5927ce5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.975822:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddf93e8c/0x1b7b50db5927ce5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.975829:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddf93e8c/0x1b7b50db5927ce5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.975862:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521929.975874:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521929.975890:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddf93e8c/0x1b7b50db5927ce5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.975897:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392c600 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521929.975901:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddf93e8c/0x1b7b50db5927ce5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.975910:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddf93e8c/0x1b7b50db5927ce5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.975924:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddf93e8c/0x1b7b50db5927ce5a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.975932:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddf93e8c/0x1b7b50db5927ce5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.975949:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521929.975951:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521929.975952:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521929.976633:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521929.976640:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c220a873/0x1b7b50db5927ce61 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.976649:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788521929.976658:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521929.976663:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c220a873/0x1b7b50db5927ce61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.976674:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c220a873/0x1b7b50db5927ce61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.976682:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c220a873/0x1b7b50db5927ce61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.976689:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c220a873/0x1b7b50db5927ce61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.976704:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521929.976713:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521929.976719:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c220a873/0x1b7b50db5927ce61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.976726:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392d000 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521929.976730:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c220a873/0x1b7b50db5927ce61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.976737:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c220a873/0x1b7b50db5927ce61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.976747:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c220a873/0x1b7b50db5927ce61 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.976763:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c220a873/0x1b7b50db5927ce61 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.976775:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521929.976776:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521929.976778:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521929.982717:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521929.982728:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd95ca5e/0x1b7b50db5927ce68 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.982743:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788521929.982747:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521929.982764:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd95ca5e/0x1b7b50db5927ce68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.982777:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd95ca5e/0x1b7b50db5927ce68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.982787:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd95ca5e/0x1b7b50db5927ce68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.982794:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd95ca5e/0x1b7b50db5927ce68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.982815:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788521929.983023:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521929.983031:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd95ca5e/0x1b7b50db5927ce68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521929.983039:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392ca00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521929.983043:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd95ca5e/0x1b7b50db5927ce68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521929.983052:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd95ca5e/0x1b7b50db5927ce68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521929.983070:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd95ca5e/0x1b7b50db5927ce68 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521929.983078:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd95ca5e/0x1b7b50db5927ce68 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521929.983116:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521929.983118:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521929.983120:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521929.984619:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521929.984633:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005db774d1/0x1b7b50db5927ce6f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.984644:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788521929.984648:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521929.984653:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005db774d1/0x1b7b50db5927ce6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.984663:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005db774d1/0x1b7b50db5927ce6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.984672:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005db774d1/0x1b7b50db5927ce6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.984679:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005db774d1/0x1b7b50db5927ce6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.984694:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521929.984704:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521929.984709:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005db774d1/0x1b7b50db5927ce6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.984716:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392c200 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521929.984720:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005db774d1/0x1b7b50db5927ce6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.984728:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005db774d1/0x1b7b50db5927ce6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.984748:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005db774d1/0x1b7b50db5927ce6f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.984768:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005db774d1/0x1b7b50db5927ce6f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.984783:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521929.984784:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521929.984786:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521929.985242:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521929.985248:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed98fa0c/0x1b7b50db5927ce76 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.985256:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788521929.985259:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521929.985264:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed98fa0c/0x1b7b50db5927ce76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.985272:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed98fa0c/0x1b7b50db5927ce76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.985281:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed98fa0c/0x1b7b50db5927ce76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.985289:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed98fa0c/0x1b7b50db5927ce76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.985314:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521929.985322:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521929.985326:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed98fa0c/0x1b7b50db5927ce76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.985332:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392d800 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521929.985335:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed98fa0c/0x1b7b50db5927ce76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.985342:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed98fa0c/0x1b7b50db5927ce76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.985351:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed98fa0c/0x1b7b50db5927ce76 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.985358:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed98fa0c/0x1b7b50db5927ce76 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.985369:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521929.985371:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521929.985373:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521929.986208:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521929.986215:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f208e074/0x1b7b50db5927ce7d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.986224:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788521929.986233:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521929.986238:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f208e074/0x1b7b50db5927ce7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.986249:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f208e074/0x1b7b50db5927ce7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.986257:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f208e074/0x1b7b50db5927ce7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.986264:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f208e074/0x1b7b50db5927ce7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.986278:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521929.986288:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521929.986292:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f208e074/0x1b7b50db5927ce7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.986299:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392cc00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521929.986303:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f208e074/0x1b7b50db5927ce7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.986310:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f208e074/0x1b7b50db5927ce7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.986321:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f208e074/0x1b7b50db5927ce7d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.986340:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f208e074/0x1b7b50db5927ce7d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.986354:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521929.986356:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521929.986358:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521929.988648:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521929.988658:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007818bbb9/0x1b7b50db5927ce84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.988672:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788521929.988676:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521929.988682:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007818bbb9/0x1b7b50db5927ce84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.988694:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007818bbb9/0x1b7b50db5927ce84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.988703:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007818bbb9/0x1b7b50db5927ce84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.988710:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007818bbb9/0x1b7b50db5927ce84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.990598:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521929.990617:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521929.990630:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007818bbb9/0x1b7b50db5927ce84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.990639:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392d200 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521929.990644:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007818bbb9/0x1b7b50db5927ce84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.990653:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007818bbb9/0x1b7b50db5927ce84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.990671:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007818bbb9/0x1b7b50db5927ce84 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.990679:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007818bbb9/0x1b7b50db5927ce84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.990703:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521929.990705:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521929.990713:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521929.991833:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521929.991841:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de155d30/0x1b7b50db5927ce8b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.991853:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788521929.991856:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521929.991863:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de155d30/0x1b7b50db5927ce8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.991899:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de155d30/0x1b7b50db5927ce8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.992559:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de155d30/0x1b7b50db5927ce8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.992569:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de155d30/0x1b7b50db5927ce8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.992592:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788521929.992870:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521929.992876:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de155d30/0x1b7b50db5927ce8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521929.992894:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392da00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521929.992899:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de155d30/0x1b7b50db5927ce8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521929.992958:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de155d30/0x1b7b50db5927ce8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521929.992976:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de155d30/0x1b7b50db5927ce8b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521929.992983:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de155d30/0x1b7b50db5927ce8b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521929.993002:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521929.993004:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521929.993006:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521929.995977:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521929.995989:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084aea67c/0x1b7b50db5927ce92 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.996004:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788521929.996009:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521929.996015:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084aea67c/0x1b7b50db5927ce92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.996030:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084aea67c/0x1b7b50db5927ce92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.996040:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084aea67c/0x1b7b50db5927ce92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.996060:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084aea67c/0x1b7b50db5927ce92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.996079:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521929.996103:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521929.996109:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084aea67c/0x1b7b50db5927ce92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.996116:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392ce00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521929.996120:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084aea67c/0x1b7b50db5927ce92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.996128:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084aea67c/0x1b7b50db5927ce92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.996159:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084aea67c/0x1b7b50db5927ce92 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.996167:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084aea67c/0x1b7b50db5927ce92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521929.996186:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521929.996188:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521929.996190:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.000375:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.000394:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb7185ef/0x1b7b50db5927ce99 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.000410:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788521930.000415:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.000422:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb7185ef/0x1b7b50db5927ce99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.000437:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb7185ef/0x1b7b50db5927ce99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.000447:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb7185ef/0x1b7b50db5927ce99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.000454:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb7185ef/0x1b7b50db5927ce99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.000474:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521930.000830:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521930.000836:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb7185ef/0x1b7b50db5927ce99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.000843:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d5000 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521930.000847:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb7185ef/0x1b7b50db5927ce99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.000855:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb7185ef/0x1b7b50db5927ce99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.000889:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb7185ef/0x1b7b50db5927ce99 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.000897:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb7185ef/0x1b7b50db5927ce99 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.000923:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.000925:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.000927:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.004520:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.004531:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057cf66cd/0x1b7b50db5927cea0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.004548:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788521930.004552:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.004558:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057cf66cd/0x1b7b50db5927cea0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.004571:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057cf66cd/0x1b7b50db5927cea0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.004581:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057cf66cd/0x1b7b50db5927cea0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.004590:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057cf66cd/0x1b7b50db5927cea0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.004620:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521930.004632:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521930.004638:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057cf66cd/0x1b7b50db5927cea0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.004646:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d5800 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521930.004651:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057cf66cd/0x1b7b50db5927cea0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.004660:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057cf66cd/0x1b7b50db5927cea0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.004675:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057cf66cd/0x1b7b50db5927cea0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.004683:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057cf66cd/0x1b7b50db5927cea0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.004698:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.004700:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.004703:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.005112:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.005118:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000650e4629/0x1b7b50db5927cea7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.005127:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788521930.005135:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.005159:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000650e4629/0x1b7b50db5927cea7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.005170:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000650e4629/0x1b7b50db5927cea7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.005178:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000650e4629/0x1b7b50db5927cea7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.005186:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000650e4629/0x1b7b50db5927cea7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.005198:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521930.005206:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521930.005211:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000650e4629/0x1b7b50db5927cea7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.005218:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d4e00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521930.005221:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000650e4629/0x1b7b50db5927cea7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.005229:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000650e4629/0x1b7b50db5927cea7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.005239:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000650e4629/0x1b7b50db5927cea7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.005256:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000650e4629/0x1b7b50db5927cea7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.005268:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.005270:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.005272:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.005645:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.005651:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b1738f4/0x1b7b50db5927ceae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.005659:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788521930.005663:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.005667:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b1738f4/0x1b7b50db5927ceae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.005676:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b1738f4/0x1b7b50db5927ceae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.005683:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b1738f4/0x1b7b50db5927ceae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.005690:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b1738f4/0x1b7b50db5927ceae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.005702:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521930.005710:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521930.005718:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b1738f4/0x1b7b50db5927ceae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.005725:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d4200 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521930.005729:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b1738f4/0x1b7b50db5927ceae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.005737:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b1738f4/0x1b7b50db5927ceae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.005748:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b1738f4/0x1b7b50db5927ceae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.005755:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b1738f4/0x1b7b50db5927ceae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.005766:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.005767:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.005769:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.006168:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.006174:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000469858fb/0x1b7b50db5927ceb5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.006182:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788521930.006184:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.006188:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000469858fb/0x1b7b50db5927ceb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.006207:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000469858fb/0x1b7b50db5927ceb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.006214:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000469858fb/0x1b7b50db5927ceb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.006220:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000469858fb/0x1b7b50db5927ceb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.006232:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521930.006238:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521930.006242:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000469858fb/0x1b7b50db5927ceb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.006248:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d4000 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521930.006251:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000469858fb/0x1b7b50db5927ceb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.006257:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000469858fb/0x1b7b50db5927ceb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.006266:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000469858fb/0x1b7b50db5927ceb5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.006273:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000469858fb/0x1b7b50db5927ceb5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.006291:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.006292:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.006294:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.006678:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.006684:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085d9fdaa/0x1b7b50db5927cebc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.006693:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788521930.006695:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.006699:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085d9fdaa/0x1b7b50db5927cebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.006708:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085d9fdaa/0x1b7b50db5927cebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.006716:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085d9fdaa/0x1b7b50db5927cebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.006723:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085d9fdaa/0x1b7b50db5927cebc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.006737:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521930.006743:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521930.006748:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085d9fdaa/0x1b7b50db5927cebc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.006763:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d5c00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521930.006766:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085d9fdaa/0x1b7b50db5927cebc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.006774:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085d9fdaa/0x1b7b50db5927cebc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.006784:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085d9fdaa/0x1b7b50db5927cebc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.006792:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085d9fdaa/0x1b7b50db5927cebc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.006804:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.006806:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.006807:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.009321:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.009331:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002413e16b/0x1b7b50db5927cec3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.009343:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788521930.009347:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.009351:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002413e16b/0x1b7b50db5927cec3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.009363:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002413e16b/0x1b7b50db5927cec3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.009379:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002413e16b/0x1b7b50db5927cec3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.009386:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002413e16b/0x1b7b50db5927cec3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.009402:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521930.009413:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521930.009418:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002413e16b/0x1b7b50db5927cec3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.009426:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d5600 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521930.009430:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002413e16b/0x1b7b50db5927cec3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.009438:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002413e16b/0x1b7b50db5927cec3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.009453:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002413e16b/0x1b7b50db5927cec3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.009460:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002413e16b/0x1b7b50db5927cec3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.009475:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.009482:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.009484:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.009887:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.009893:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078ac0797/0x1b7b50db5927ceca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.009901:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788521930.009904:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.009908:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078ac0797/0x1b7b50db5927ceca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.009917:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078ac0797/0x1b7b50db5927ceca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.009924:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078ac0797/0x1b7b50db5927ceca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.009931:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078ac0797/0x1b7b50db5927ceca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.009945:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521930.009953:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521930.009957:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078ac0797/0x1b7b50db5927ceca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.009964:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d5400 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521930.009968:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078ac0797/0x1b7b50db5927ceca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.009986:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078ac0797/0x1b7b50db5927ceca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.009997:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078ac0797/0x1b7b50db5927ceca lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.010005:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078ac0797/0x1b7b50db5927ceca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.010018:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.010020:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.010021:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.010425:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.010431:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f3d53b9/0x1b7b50db5927ced1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.010440:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788521930.010443:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.010447:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f3d53b9/0x1b7b50db5927ced1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.010456:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f3d53b9/0x1b7b50db5927ced1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.010464:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f3d53b9/0x1b7b50db5927ced1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.010477:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f3d53b9/0x1b7b50db5927ced1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.010490:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521930.010499:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521930.010502:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f3d53b9/0x1b7b50db5927ced1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.010509:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d5a00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521930.010512:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f3d53b9/0x1b7b50db5927ced1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.010521:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f3d53b9/0x1b7b50db5927ced1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.010532:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f3d53b9/0x1b7b50db5927ced1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.010540:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f3d53b9/0x1b7b50db5927ced1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.010553:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.010555:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.010556:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.010925:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.010937:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f248455/0x1b7b50db5927ced8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.010945:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788521930.010947:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.010951:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f248455/0x1b7b50db5927ced8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.010960:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f248455/0x1b7b50db5927ced8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.010969:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f248455/0x1b7b50db5927ced8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.010976:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f248455/0x1b7b50db5927ced8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.010988:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521930.010997:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521930.011000:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f248455/0x1b7b50db5927ced8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.011007:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d4400 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521930.011011:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f248455/0x1b7b50db5927ced8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.011019:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f248455/0x1b7b50db5927ced8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.011036:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f248455/0x1b7b50db5927ced8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.011044:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f248455/0x1b7b50db5927ced8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.011058:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.011060:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.011062:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.011472:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.011478:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c220a873/0x1b7b50db5927cedf lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.011487:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788521930.011489:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.011493:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c220a873/0x1b7b50db5927cedf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.011502:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c220a873/0x1b7b50db5927cedf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.011510:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c220a873/0x1b7b50db5927cedf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.011518:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c220a873/0x1b7b50db5927cedf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.011543:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521930.011551:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521930.011555:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c220a873/0x1b7b50db5927cedf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.011562:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392d000 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521930.011566:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c220a873/0x1b7b50db5927cedf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.011574:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c220a873/0x1b7b50db5927cedf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.011586:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c220a873/0x1b7b50db5927cedf lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.011609:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c220a873/0x1b7b50db5927cedf lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.011622:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.011624:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.011625:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.014894:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.014905:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084aea67c/0x1b7b50db5927cee6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.014931:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788521930.014941:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.014947:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084aea67c/0x1b7b50db5927cee6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.014961:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084aea67c/0x1b7b50db5927cee6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.014971:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084aea67c/0x1b7b50db5927cee6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.014979:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084aea67c/0x1b7b50db5927cee6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.014994:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788521930.015621:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.015628:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007818bbb9/0x1b7b50db5927ceed lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.015637:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788521930.015639:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.015643:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007818bbb9/0x1b7b50db5927ceed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.015651:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007818bbb9/0x1b7b50db5927ceed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.015659:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007818bbb9/0x1b7b50db5927ceed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.015672:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007818bbb9/0x1b7b50db5927ceed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.015687:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788521930.015701:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788521930.015706:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084aea67c/0x1b7b50db5927cee6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.015713:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392ce00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521930.015718:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084aea67c/0x1b7b50db5927cee6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.015726:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084aea67c/0x1b7b50db5927cee6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.015741:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084aea67c/0x1b7b50db5927cee6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.015859:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084aea67c/0x1b7b50db5927cee6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.015889:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521930.015893:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007818bbb9/0x1b7b50db5927ceed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.015957:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392d200 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521930.015961:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007818bbb9/0x1b7b50db5927ceed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.015969:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007818bbb9/0x1b7b50db5927ceed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.015980:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007818bbb9/0x1b7b50db5927ceed lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.015987:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007818bbb9/0x1b7b50db5927ceed lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.016000:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.016002:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.016004:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.016599:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.016605:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f208e074/0x1b7b50db5927cef4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.016614:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.016617:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.016621:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f208e074/0x1b7b50db5927cef4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.016632:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f208e074/0x1b7b50db5927cef4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.016646:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f208e074/0x1b7b50db5927cef4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.016654:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f208e074/0x1b7b50db5927cef4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.016667:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521930.016675:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521930.016679:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f208e074/0x1b7b50db5927cef4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.016685:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392cc00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521930.016688:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f208e074/0x1b7b50db5927cef4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.016696:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f208e074/0x1b7b50db5927cef4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.016707:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f208e074/0x1b7b50db5927cef4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.016715:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f208e074/0x1b7b50db5927cef4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.016726:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.016733:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.016734:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.017348:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.017354:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed98fa0c/0x1b7b50db5927cefb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.017363:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.017366:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.017371:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed98fa0c/0x1b7b50db5927cefb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.017381:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed98fa0c/0x1b7b50db5927cefb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.017388:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed98fa0c/0x1b7b50db5927cefb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.017397:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed98fa0c/0x1b7b50db5927cefb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.017411:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521930.017419:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521930.017422:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed98fa0c/0x1b7b50db5927cefb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.017429:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392d800 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521930.017433:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed98fa0c/0x1b7b50db5927cefb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.017452:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed98fa0c/0x1b7b50db5927cefb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.017463:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed98fa0c/0x1b7b50db5927cefb lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.017471:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed98fa0c/0x1b7b50db5927cefb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.017485:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.017665:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.017667:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.020393:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.020404:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005db774d1/0x1b7b50db5927cf02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.020418:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.020423:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.020429:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005db774d1/0x1b7b50db5927cf02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.020442:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005db774d1/0x1b7b50db5927cf02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.020451:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005db774d1/0x1b7b50db5927cf02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.020471:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005db774d1/0x1b7b50db5927cf02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.020706:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521930.020719:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521930.020725:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005db774d1/0x1b7b50db5927cf02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.020733:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392c200 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521930.020737:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005db774d1/0x1b7b50db5927cf02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.020745:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005db774d1/0x1b7b50db5927cf02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.020770:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005db774d1/0x1b7b50db5927cf02 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.020777:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005db774d1/0x1b7b50db5927cf02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.020792:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.020794:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.020795:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.021281:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.021295:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd95ca5e/0x1b7b50db5927cf09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.021303:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.021307:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.021311:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd95ca5e/0x1b7b50db5927cf09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.021320:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd95ca5e/0x1b7b50db5927cf09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.021328:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd95ca5e/0x1b7b50db5927cf09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.021335:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd95ca5e/0x1b7b50db5927cf09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.021349:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521930.021357:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521930.021361:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd95ca5e/0x1b7b50db5927cf09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.021368:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392ca00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521930.021371:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd95ca5e/0x1b7b50db5927cf09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.021379:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd95ca5e/0x1b7b50db5927cf09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.021397:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd95ca5e/0x1b7b50db5927cf09 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.021405:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd95ca5e/0x1b7b50db5927cf09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.021418:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.021420:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.021422:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.021812:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.021818:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddf93e8c/0x1b7b50db5927cf10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.021826:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.021828:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.021832:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddf93e8c/0x1b7b50db5927cf10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.021841:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddf93e8c/0x1b7b50db5927cf10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.021849:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddf93e8c/0x1b7b50db5927cf10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.021855:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddf93e8c/0x1b7b50db5927cf10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.021890:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521930.021900:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521930.021904:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddf93e8c/0x1b7b50db5927cf10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.021911:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392c600 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521930.021914:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddf93e8c/0x1b7b50db5927cf10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.021923:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddf93e8c/0x1b7b50db5927cf10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.021933:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddf93e8c/0x1b7b50db5927cf10 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.021940:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddf93e8c/0x1b7b50db5927cf10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.021952:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.021954:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.021955:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788521930.022119:0:15107:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:3.0:1788521930.022244:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14448:x1875400816950144:12345-0@lo:5:osp-pre-0-0.0 Request processed in 71204us (72278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521930.022254:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788521930.022309:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f812ead80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14448:1875400816950144:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788521930.022324:0:14448:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1788521930.022362:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860db100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14448:1875400816950400:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788521930.022394:0:14448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521930.022425:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f983fd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521930.022445:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816950400 00000100:00100000:3.0:1788521930.022450:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816950400 00000100:00100000:3.0:1788521930.022481:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788521930.022491:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14450:x1875400816950272:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788521930.027428:0:15108:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788521930.027438:0:15108:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1788521930.027443:0:15108:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00010000:00010000:2.0:1788521930.031901:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.041654:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.041667:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de155d30/0x1b7b50db5927cf17 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.041683:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.041688:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.041695:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de155d30/0x1b7b50db5927cf17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.041713:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de155d30/0x1b7b50db5927cf17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.041723:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de155d30/0x1b7b50db5927cf17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.041743:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de155d30/0x1b7b50db5927cf17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.042293:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521930.042572:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521930.042586:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de155d30/0x1b7b50db5927cf17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521930.042596:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392da00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:2.0:1788521930.042601:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de155d30/0x1b7b50db5927cf17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521930.042611:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de155d30/0x1b7b50db5927cf17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521930.042630:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de155d30/0x1b7b50db5927cf17 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521930.042638:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de155d30/0x1b7b50db5927cf17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521930.042660:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521930.042662:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521930.042663:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.044058:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.044067:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927cf1e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.044079:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.044082:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.044223:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927cf1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.044235:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927cf1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.044243:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927cf1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.044250:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927cf1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.044265:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521930.044275:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521930.044279:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927cf1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.044292:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d5400 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521930.044296:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927cf1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.044303:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927cf1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.044314:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927cf1e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.044320:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927cf1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.044344:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.044346:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.044347:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.045294:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.045302:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002413e16b/0x1b7b50db5927cf25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.045312:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.045315:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.045319:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002413e16b/0x1b7b50db5927cf25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.045337:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002413e16b/0x1b7b50db5927cf25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.045353:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002413e16b/0x1b7b50db5927cf25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.045360:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002413e16b/0x1b7b50db5927cf25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.045376:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521930.045386:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521930.045390:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002413e16b/0x1b7b50db5927cf25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.045396:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d5600 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521930.045400:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002413e16b/0x1b7b50db5927cf25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.045407:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002413e16b/0x1b7b50db5927cf25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.045419:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002413e16b/0x1b7b50db5927cf25 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.045427:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002413e16b/0x1b7b50db5927cf25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.045441:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.045451:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.045453:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.046301:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.046308:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085d9fdaa/0x1b7b50db5927cf2c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.046317:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.046320:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.046325:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085d9fdaa/0x1b7b50db5927cf2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.046402:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085d9fdaa/0x1b7b50db5927cf2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.046411:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085d9fdaa/0x1b7b50db5927cf2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.046419:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085d9fdaa/0x1b7b50db5927cf2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.046473:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788521930.047036:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.047042:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000469858fb/0x1b7b50db5927cf33 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.047050:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.047053:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.047056:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000469858fb/0x1b7b50db5927cf33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.047073:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000469858fb/0x1b7b50db5927cf33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.047081:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000469858fb/0x1b7b50db5927cf33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.047223:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000469858fb/0x1b7b50db5927cf33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788521930.049770:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788521930.051306:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788521930.051316:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085d9fdaa/0x1b7b50db5927cf2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.051349:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d5c00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521930.051354:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085d9fdaa/0x1b7b50db5927cf2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.051366:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085d9fdaa/0x1b7b50db5927cf2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.051387:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085d9fdaa/0x1b7b50db5927cf2c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.051395:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085d9fdaa/0x1b7b50db5927cf2c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.051415:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521930.051418:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000469858fb/0x1b7b50db5927cf33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.051425:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d4000 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521930.051428:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000469858fb/0x1b7b50db5927cf33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.051435:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000469858fb/0x1b7b50db5927cf33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.051444:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000469858fb/0x1b7b50db5927cf33 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.051458:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521930.051459:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521930.051461:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.056933:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788521930.056945:0:15108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000469858fb/0x1b7b50db5927cf33 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.056984:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.057530:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.057538:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f248455/0x1b7b50db5927cf3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.057551:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.057556:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.057562:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f248455/0x1b7b50db5927cf3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.057576:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f248455/0x1b7b50db5927cf3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.057598:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f248455/0x1b7b50db5927cf3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.057606:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f248455/0x1b7b50db5927cf3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.057621:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521930.057629:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521930.057634:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f248455/0x1b7b50db5927cf3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.057641:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d4400 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521930.057646:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f248455/0x1b7b50db5927cf3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.057656:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f248455/0x1b7b50db5927cf3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.057671:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f248455/0x1b7b50db5927cf3a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.057678:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f248455/0x1b7b50db5927cf3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.057690:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.057696:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.057698:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.058103:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.058109:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f3d53b9/0x1b7b50db5927cf41 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.058130:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.058133:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.058137:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f3d53b9/0x1b7b50db5927cf41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.058197:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f3d53b9/0x1b7b50db5927cf41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.058207:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f3d53b9/0x1b7b50db5927cf41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.058214:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f3d53b9/0x1b7b50db5927cf41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.058227:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521930.058234:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521930.058238:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f3d53b9/0x1b7b50db5927cf41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.058245:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d5a00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521930.058248:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f3d53b9/0x1b7b50db5927cf41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.058267:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f3d53b9/0x1b7b50db5927cf41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.058278:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f3d53b9/0x1b7b50db5927cf41 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.058286:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f3d53b9/0x1b7b50db5927cf41 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.058300:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.058301:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.058303:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.058710:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.058717:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927cf48 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.058725:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.058729:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.058733:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927cf48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.058743:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927cf48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.058751:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927cf48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.058763:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927cf48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.058787:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788521930.059172:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.059178:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b1738f4/0x1b7b50db5927cf4f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.059186:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.059189:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.059193:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b1738f4/0x1b7b50db5927cf4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.059202:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b1738f4/0x1b7b50db5927cf4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.059211:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b1738f4/0x1b7b50db5927cf4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.059219:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b1738f4/0x1b7b50db5927cf4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.059230:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788521930.059237:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788521930.059241:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927cf48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.059253:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d5400 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521930.059257:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927cf48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.059266:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927cf48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.059278:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927cf48 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.059286:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927cf48 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.059299:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521930.059302:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b1738f4/0x1b7b50db5927cf4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.059308:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d4200 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521930.059312:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b1738f4/0x1b7b50db5927cf4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.059320:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b1738f4/0x1b7b50db5927cf4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.059329:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b1738f4/0x1b7b50db5927cf4f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.059341:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b1738f4/0x1b7b50db5927cf4f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.059352:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.059354:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.059356:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521930.059814:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.059915:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.059920:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000650e4629/0x1b7b50db5927cf56 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.059929:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.059932:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.059936:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650e4629/0x1b7b50db5927cf56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.059946:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000650e4629/0x1b7b50db5927cf56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.059955:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000650e4629/0x1b7b50db5927cf56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.059961:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000650e4629/0x1b7b50db5927cf56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.060009:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788521930.060424:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.060435:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057cf66cd/0x1b7b50db5927cf5d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.060443:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.060447:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.060451:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057cf66cd/0x1b7b50db5927cf5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.060461:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057cf66cd/0x1b7b50db5927cf5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.060470:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057cf66cd/0x1b7b50db5927cf5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.060477:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057cf66cd/0x1b7b50db5927cf5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.060530:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788521930.060536:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000650e4629/0x1b7b50db5927cf56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.060544:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d4e00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521930.060547:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000650e4629/0x1b7b50db5927cf56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.060556:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000650e4629/0x1b7b50db5927cf56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.060568:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000650e4629/0x1b7b50db5927cf56 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.060577:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000650e4629/0x1b7b50db5927cf56 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.060592:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521930.060596:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057cf66cd/0x1b7b50db5927cf5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.060603:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d5800 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521930.060612:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057cf66cd/0x1b7b50db5927cf5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.060620:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057cf66cd/0x1b7b50db5927cf5d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.060629:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057cf66cd/0x1b7b50db5927cf5d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.060636:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521930.060638:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521930.060640:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.060702:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788521930.060707:0:15108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057cf66cd/0x1b7b50db5927cf5d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788521930.061081:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.061087:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927cf64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.061095:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.061098:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.061107:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927cf64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.061117:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927cf64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.061125:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927cf64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.061132:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927cf64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.061180:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521930.061186:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927cf64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.061193:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d5000 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521930.061197:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927cf64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.061205:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927cf64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.061217:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927cf64 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.061225:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521930.061231:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521930.061233:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.061303:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788521930.061308:0:15108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927cf64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788521930.061692:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.061698:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddf93e8c/0x1b7b50db5927cf6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.061706:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.061709:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.061714:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ddf93e8c/0x1b7b50db5927cf6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.061724:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ddf93e8c/0x1b7b50db5927cf6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.061743:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddf93e8c/0x1b7b50db5927cf6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.061752:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ddf93e8c/0x1b7b50db5927cf6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.061781:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521930.061785:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ddf93e8c/0x1b7b50db5927cf6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.061792:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392c600 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521930.061795:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddf93e8c/0x1b7b50db5927cf6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.061804:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddf93e8c/0x1b7b50db5927cf6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.061813:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ddf93e8c/0x1b7b50db5927cf6b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.061822:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521930.061824:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521930.061827:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.061886:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788521930.061891:0:15108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddf93e8c/0x1b7b50db5927cf6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788521930.062496:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.062501:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd95ca5e/0x1b7b50db5927cf72 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.062510:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.062513:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.062517:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd95ca5e/0x1b7b50db5927cf72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.062526:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd95ca5e/0x1b7b50db5927cf72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.062535:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd95ca5e/0x1b7b50db5927cf72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.062551:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd95ca5e/0x1b7b50db5927cf72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.062611:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521930.062616:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd95ca5e/0x1b7b50db5927cf72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.062624:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392ca00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521930.062627:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd95ca5e/0x1b7b50db5927cf72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.062635:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd95ca5e/0x1b7b50db5927cf72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.062651:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd95ca5e/0x1b7b50db5927cf72 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.062660:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521930.062661:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521930.062663:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.062716:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788521930.062721:0:15108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd95ca5e/0x1b7b50db5927cf72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788521930.063247:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.063253:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005db774d1/0x1b7b50db5927cf79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.063262:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.063266:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.063269:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005db774d1/0x1b7b50db5927cf79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.063278:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005db774d1/0x1b7b50db5927cf79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.063286:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005db774d1/0x1b7b50db5927cf79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.063293:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005db774d1/0x1b7b50db5927cf79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.063456:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521930.063461:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005db774d1/0x1b7b50db5927cf79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.063470:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392c200 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521930.063474:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005db774d1/0x1b7b50db5927cf79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.063482:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005db774d1/0x1b7b50db5927cf79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.063494:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005db774d1/0x1b7b50db5927cf79 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.063502:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521930.063504:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521930.063505:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.063554:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788521930.063558:0:15108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005db774d1/0x1b7b50db5927cf79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788521930.063955:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.063961:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed98fa0c/0x1b7b50db5927cf80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.063968:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.063971:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.063976:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed98fa0c/0x1b7b50db5927cf80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.063985:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed98fa0c/0x1b7b50db5927cf80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.063994:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed98fa0c/0x1b7b50db5927cf80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.064002:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed98fa0c/0x1b7b50db5927cf80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.064029:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521930.064034:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed98fa0c/0x1b7b50db5927cf80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.064050:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392d800 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521930.064054:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed98fa0c/0x1b7b50db5927cf80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.064063:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed98fa0c/0x1b7b50db5927cf80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.064073:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed98fa0c/0x1b7b50db5927cf80 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.064083:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521930.064084:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521930.064086:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.064137:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788521930.064157:0:15108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed98fa0c/0x1b7b50db5927cf80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788521930.064550:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.064555:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f208e074/0x1b7b50db5927cf87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.064564:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.064566:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.064570:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f208e074/0x1b7b50db5927cf87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.064580:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f208e074/0x1b7b50db5927cf87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.064588:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f208e074/0x1b7b50db5927cf87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.064596:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f208e074/0x1b7b50db5927cf87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.064635:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521930.064639:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f208e074/0x1b7b50db5927cf87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.064647:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392cc00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521930.064650:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f208e074/0x1b7b50db5927cf87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.064659:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f208e074/0x1b7b50db5927cf87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.064671:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f208e074/0x1b7b50db5927cf87 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.064685:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521930.064686:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521930.064689:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.064738:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788521930.064742:0:15108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f208e074/0x1b7b50db5927cf87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788521930.065133:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.065138:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007818bbb9/0x1b7b50db5927cf8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.065182:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.065185:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.065190:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007818bbb9/0x1b7b50db5927cf8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.065200:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007818bbb9/0x1b7b50db5927cf8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.065208:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007818bbb9/0x1b7b50db5927cf8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.065216:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007818bbb9/0x1b7b50db5927cf8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.065269:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521930.065275:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007818bbb9/0x1b7b50db5927cf8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.065281:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392d200 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521930.065285:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007818bbb9/0x1b7b50db5927cf8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.065293:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007818bbb9/0x1b7b50db5927cf8e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.065304:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007818bbb9/0x1b7b50db5927cf8e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.065313:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521930.065314:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521930.065316:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.065363:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788521930.065368:0:15108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007818bbb9/0x1b7b50db5927cf8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788521930.065737:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.065743:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084aea67c/0x1b7b50db5927cf95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.065752:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.065755:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.065758:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084aea67c/0x1b7b50db5927cf95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.065777:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084aea67c/0x1b7b50db5927cf95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.065785:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084aea67c/0x1b7b50db5927cf95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.065792:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084aea67c/0x1b7b50db5927cf95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.065817:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521930.065821:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084aea67c/0x1b7b50db5927cf95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.065828:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392ce00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521930.065831:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084aea67c/0x1b7b50db5927cf95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.065843:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084aea67c/0x1b7b50db5927cf95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.065854:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084aea67c/0x1b7b50db5927cf95 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.065862:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521930.065864:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521930.065866:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.065923:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788521930.065928:0:15108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084aea67c/0x1b7b50db5927cf95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.066284:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.072346:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.072358:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c220a873/0x1b7b50db5927cf9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.072374:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.072379:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.072385:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c220a873/0x1b7b50db5927cf9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.072399:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c220a873/0x1b7b50db5927cf9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.072421:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c220a873/0x1b7b50db5927cf9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.072430:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c220a873/0x1b7b50db5927cf9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.072448:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521930.072459:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521930.072464:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c220a873/0x1b7b50db5927cf9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.072473:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392d000 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521930.072478:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c220a873/0x1b7b50db5927cf9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.072494:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c220a873/0x1b7b50db5927cf9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.072509:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c220a873/0x1b7b50db5927cf9c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.072517:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c220a873/0x1b7b50db5927cf9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.072535:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.072542:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.072543:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.073129:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.073136:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de155d30/0x1b7b50db5927cfa3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.073165:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.073169:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.073173:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de155d30/0x1b7b50db5927cfa3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.073183:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de155d30/0x1b7b50db5927cfa3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.073191:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de155d30/0x1b7b50db5927cfa3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.073198:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de155d30/0x1b7b50db5927cfa3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.073214:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521930.073223:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521930.073227:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de155d30/0x1b7b50db5927cfa3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.073234:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392da00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521930.073290:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de155d30/0x1b7b50db5927cfa3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.073311:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de155d30/0x1b7b50db5927cfa3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.073323:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de155d30/0x1b7b50db5927cfa3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.073331:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de155d30/0x1b7b50db5927cfa3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.073344:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.073346:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.073347:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.073963:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.073969:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927cfaa lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.073978:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.073981:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.073986:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927cfaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.073996:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927cfaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.074004:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927cfaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.074024:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927cfaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.074039:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521930.074047:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521930.074051:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927cfaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.074058:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d5000 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521930.074061:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927cfaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.074070:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927cfaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.074082:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927cfaa lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.074090:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927cfaa lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.074102:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.074104:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.074105:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.074616:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.074629:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057cf66cd/0x1b7b50db5927cfb1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.074637:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.074640:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.074645:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057cf66cd/0x1b7b50db5927cfb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.074654:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057cf66cd/0x1b7b50db5927cfb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.075077:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057cf66cd/0x1b7b50db5927cfb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.075089:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057cf66cd/0x1b7b50db5927cfb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.075111:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788521930.075197:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521930.075204:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057cf66cd/0x1b7b50db5927cfb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.075214:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d5800 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521930.075219:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057cf66cd/0x1b7b50db5927cfb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.075228:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057cf66cd/0x1b7b50db5927cfb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.075242:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057cf66cd/0x1b7b50db5927cfb1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.075250:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057cf66cd/0x1b7b50db5927cfb1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.075278:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521930.075281:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521930.075282:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.076166:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.076174:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b1738f4/0x1b7b50db5927cfb8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.076183:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.076186:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.076191:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b1738f4/0x1b7b50db5927cfb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.076202:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b1738f4/0x1b7b50db5927cfb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.076216:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b1738f4/0x1b7b50db5927cfb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.076224:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b1738f4/0x1b7b50db5927cfb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.076240:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788521930.076613:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521930.076619:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b1738f4/0x1b7b50db5927cfb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.076626:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d4200 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521930.076629:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b1738f4/0x1b7b50db5927cfb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.076635:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b1738f4/0x1b7b50db5927cfb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.076646:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b1738f4/0x1b7b50db5927cfb8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.076652:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b1738f4/0x1b7b50db5927cfb8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.076672:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521930.076674:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521930.076677:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.076726:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.076733:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927cfbf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.076742:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.076745:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.076749:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927cfbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.076759:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927cfbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.076767:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927cfbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.076775:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927cfbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.076805:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788521930.076891:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521930.076897:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927cfbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.076919:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d5400 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521930.076923:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927cfbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.076932:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927cfbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.076945:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927cfbf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.076952:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927cfbf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.076971:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521930.076974:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521930.076977:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.077212:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.077219:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f3d53b9/0x1b7b50db5927cfc6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.077228:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.077231:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.077235:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f3d53b9/0x1b7b50db5927cfc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.077245:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f3d53b9/0x1b7b50db5927cfc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.077254:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f3d53b9/0x1b7b50db5927cfc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.077261:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f3d53b9/0x1b7b50db5927cfc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.077278:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521930.077287:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521930.077292:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f3d53b9/0x1b7b50db5927cfc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.077300:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d5a00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521930.077309:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f3d53b9/0x1b7b50db5927cfc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.077319:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f3d53b9/0x1b7b50db5927cfc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.077331:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f3d53b9/0x1b7b50db5927cfc6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.077337:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f3d53b9/0x1b7b50db5927cfc6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.077357:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.077360:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.077363:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.077817:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.077823:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f248455/0x1b7b50db5927cfcd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.077831:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.077834:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.077839:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f248455/0x1b7b50db5927cfcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.077848:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f248455/0x1b7b50db5927cfcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.077857:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f248455/0x1b7b50db5927cfcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.077869:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f248455/0x1b7b50db5927cfcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.077904:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788521930.077954:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521930.077960:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f248455/0x1b7b50db5927cfcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.077968:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d4400 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521930.077973:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f248455/0x1b7b50db5927cfcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.077982:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f248455/0x1b7b50db5927cfcd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.078003:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f248455/0x1b7b50db5927cfcd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.078011:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f248455/0x1b7b50db5927cfcd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521930.078031:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521930.078033:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521930.078036:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521930.078334:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521930.078341:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085d9fdaa/0x1b7b50db5927cfd4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.078350:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788521930.078353:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521930.078358:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085d9fdaa/0x1b7b50db5927cfd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.078368:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085d9fdaa/0x1b7b50db5927cfd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.078377:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085d9fdaa/0x1b7b50db5927cfd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.078385:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085d9fdaa/0x1b7b50db5927cfd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.078401:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521930.078410:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521930.078414:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085d9fdaa/0x1b7b50db5927cfd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.078428:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d5c00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:3.0:1788521930.078431:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085d9fdaa/0x1b7b50db5927cfd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.078439:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085d9fdaa/0x1b7b50db5927cfd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.078450:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085d9fdaa/0x1b7b50db5927cfd4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.078458:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085d9fdaa/0x1b7b50db5927cfd4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.078471:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.078473:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521930.078474:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788521930.078707:0:15108:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:3.0:1788521930.078793:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14450:x1875400816950272:12345-0@lo:5:osp-pre-1-0.0 Request processed in 56300us (127868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521930.078802:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788521930.078851:0:14450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14450:1875400816950272:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788521930.078868:0:14450:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:3.0:1788521930.078925:0:14450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860d8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14450:1875400816950528:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788521930.078959:0:14450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521930.079011:0:14450:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f983fd780 going to sleep for 11 seconds 00000100:00100000:3.0:1788521930.079029:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816950528 00000100:00100000:3.0:1788521930.079035:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816950528 00000100:00100000:3.0:1788521930.079077:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788521930.079087:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14448:x1875400816950400:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788521930.079123:0:15106:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000004:00080000:0.0:1788521930.086586:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788521930.086917:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14448:x1875400816950400:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7828us (64518us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788521930.086929:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788521930.086957:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788521930.086967:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860db100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14448:1875400816950400:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788521930.086970:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14450:x1875400816950528:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788521930.086987:0:14448:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00002000:00080000:3.0:1788521930.087010:0:15106:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1788521930.094021:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14450:x1875400816950528:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7051us (15056us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788521930.094034:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788521930.094103:0:14450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860d8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14450:1875400816950528:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788521930.094119:0:14450:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1788521930.127337:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788521930.959293:0:14423:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788521930.959301:0:14423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff996fb47cf000 from 8 10000000:01000000:1.0:1788521930.959360:0:14423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788521930.959398:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4000/0x1b7b50db5927cfdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521930.959410:0:14423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4000/0x1b7b50db5927cfdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521930.959422:0:14423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4000/0x1b7b50db5927cfdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521930.959443:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816950656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788521930.959512:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521930.959622:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb18d7900 going to sleep for 11 seconds 00000100:00100000:3.0:1788521930.963867:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816950656 00000100:00100000:3.0:1788521930.963886:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816950656 00000100:00100000:3.0:1788521930.964100:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788521930.964110:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5faf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+18:14423:x1875400816950656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521930.964126:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521930.964155:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f829d5c00/0x1b7b50db5927cfe2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927cfdb expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.964179:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f829d5c00/0x1b7b50db5927cfe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927cfdb expref: 19 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.964191:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f829d5c00/0x1b7b50db5927cfe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927cfdb expref: 19 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521930.964207:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f829d5c00, rc 0) 00000100:00100000:3.0:1788521930.964276:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5faf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+19:14423:x1875400816950656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (4763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521930.964282:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788521930.968025:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816950656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521930.968053:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4000/0x1b7b50db5927cfdb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cfe2 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521930.968066:0:14423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4000/0x1b7b50db5927cfdb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927cfe2 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521930.968132:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816950784:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788521930.968229:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521930.968273:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90d8f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788521930.968276:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816950784 00000100:00100000:0.0:1788521930.968282:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816950784 00000100:00100000:2.0:1788521930.968389:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788521930.968398:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+19:14423:x1875400816950784:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788521930.968415:0:14420:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788521930.968430:0:14420:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788521930.968433:0:14420:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788521930.969222:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+19:14423:x1875400816950784:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 824us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521930.969232:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788521930.969272:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816950784:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788521930.969328:0:14423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788521930.969336:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4000/0x1b7b50db5927cfdb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cfe2 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521930.969344:0:14423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4000/0x1b7b50db5927cfdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927cfe2 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521931.150368:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788521931.731406:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788521931.731425:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:3.0:1788521932.175774:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521933.199509:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521934.229788:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788521934.371990:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788521934.372009:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:3.0:1788521935.183598:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816950912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521935.183665:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521935.183725:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788521935.183731:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816951040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521935.183752:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521935.185178:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816950912 00000100:00100000:1.0:1788521935.185186:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816950912 00000100:00100000:1.0:1788521935.185232:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816951040 00000100:00100000:1.0:1788521935.185236:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816951040 00000100:00100000:1.0:1788521935.185255:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788521935.185263:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816950912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788521935.185295:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521935.185349:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816950912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (1683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521935.185356:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788521935.185371:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788521935.185377:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816951040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521935.185393:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521935.185419:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816951040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (1666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521935.185425:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788521935.185448:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875400816951296:0@lo:400:kworker.0 00000100:00100000:1.0:1788521935.185477:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521935.185502:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788521935.185507:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1e22794d-c642-4031-a520-725ebfafbfe5:3305:1875400816951168:0@lo:400:kworker.0 00000100:00100000:1.0:1788521935.185534:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521935.185582:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816951168 00000100:00100000:1.0:1788521935.185586:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816951168 00000100:00100000:1.0:1788521935.185612:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788521935.185618:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+19:3305:x1875400816951168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521935.185651:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+19:3305:x1875400816951168:12345-0@lo:400:kworker.0 Request processed in 33us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521935.185668:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788521935.185881:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1e22794d-c642-4031-a520-725ebfafbfe5:3305:1875400816951168:0@lo:400:kworker.0 00000100:00080000:2.0:1788521935.188741:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521935.188750:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521935.188961:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816951296 00000100:00100000:3.0:1788521935.188972:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816951296 00000100:00100000:3.0:1788521935.189037:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788521935.189049:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875400816951296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521935.189173:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875400816951296:12345-0@lo:400:kworker.0 Request processed in 127us (3694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521935.189181:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788521935.189208:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875400816951552:0@lo:400:kworker.0 00000100:00100000:3.0:1788521935.189244:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521935.189271:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788521935.189278:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875400816951424:0@lo:400:kworker.0 00000100:00100000:3.0:1788521935.189316:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521935.189352:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816951552 00000100:00100000:3.0:1788521935.189356:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816951552 00000100:00100000:3.0:1788521935.189386:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816951424 00000100:00100000:3.0:1788521935.189389:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816951424 00000100:00100000:3.0:1788521935.189404:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788521935.189410:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875400816951552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521935.189445:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875400816951552:12345-0@lo:400:kworker.0 Request processed in 34us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521935.189451:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788521935.189463:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788521935.189470:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875400816951424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521935.189497:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875400816951424:12345-0@lo:400:kworker.0 Request processed in 29us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521935.189503:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788521935.189516:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788521935.189543:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996f85d36d80 x1875400816951424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521935.189557:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875400816951424:0@lo:400:kworker.0 00010000:00080000:3.0:1788521935.189568:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996f85d34000 x1875400816951552/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521935.189576:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875400816951552:0@lo:400:kworker.0 00010000:00080000:3.0:1788521935.189607:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996f85d37b80 x1875400816951296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521935.189617:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875400816951296:0@lo:400:kworker.0 00000100:00100000:3.0:1788521935.189639:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788521935.189666:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816951040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521935.189680:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788521935.189703:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816950912:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788521935.255322:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788521935.517698:0:16181:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788521936.270746:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788521936.655582:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788521937.297315:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521937.869094:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521937.869213:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799132416 00000100:00100000:0.0:1788521937.869222:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799132416 00000100:00100000:0.0:1788521937.869322:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 75 00000100:00100000:0.0:1788521937.869331:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2360:x1875400799132416:12345-192.168.206.48@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788521937.869359:0:14419:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439@192.168.206.48@tcp t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:0.0:1788521937.869386:0:14419:0:(genops.c:1385:class_connect()) connect: client 2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439, cookie 0x1b7b50db5927cfe9 00000100:00080000:0.0:1788521937.869797:0:14419:0:(import.c:65:import_set_state_nolock()) ffff996fb47c6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788521937.869872:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+5:2360:x1875400799132416:12345-192.168.206.48@tcp:250:mount.lustre.0 Request processed in 540us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521937.869881:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 75 00000100:00100000:2.0:1788521937.875552:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521937.880031:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799132544 00000100:00100000:1.0:1788521937.880046:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799132544 00000100:00100000:1.0:1788521937.880099:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 76 00000100:00100000:1.0:1788521937.880680:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+5:13745:x1875400799132544:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788521937.880699:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521937.880718:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996fbc6d4200/0x1b7b50db5927cff0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00d36 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521937.880753:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fbc6d4200/0x1b7b50db5927cff0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d36 expref: 6 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521937.880766:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996fbc6d4200/0x1b7b50db5927cff0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d36 expref: 6 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521937.880775:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d4200, rc 0) 00000100:00100000:1.0:1788521937.881211:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+6:13745:x1875400799132544:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 1101us (5665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521937.881220:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 76 00000100:00100000:1.0:1788521937.885822:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521937.889375:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799132672 00000100:00100000:3.0:1788521937.889390:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799132672 00000100:00100000:3.0:1788521937.889445:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 77 00000100:00100000:3.0:1788521937.889455:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+6:13745:x1875400799132672:12345-192.168.206.48@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788521937.898914:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+6:13745:x1875400799132672:12345-192.168.206.48@tcp:501:mount.lustre.0 Request processed in 9450us (13090us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788521937.898929:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 77 00000100:00100000:2.0:1788521937.904407:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521937.904499:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799132800 00000100:00100000:3.0:1788521937.904508:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799132800 00000100:00100000:3.0:1788521937.904563:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 78 00000100:00100000:3.0:1788521937.904573:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+6:13745:x1875400799132800:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788521937.904589:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521937.904605:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f829d5a00/0x1b7b50db5927cff7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00d3d expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521937.904633:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f829d5a00/0x1b7b50db5927cff7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d3d expref: 7 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521937.904644:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f829d5a00/0x1b7b50db5927cff7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d3d expref: 7 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521937.904652:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f829d5a00, rc 0) 00000100:00100000:3.0:1788521937.904717:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+7:13745:x1875400799132800:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 146us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521937.904724:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 78 00000100:00100000:2.0:1788521937.909649:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521937.909756:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799132928 00000100:00100000:3.0:1788521937.909765:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799132928 00000100:00100000:3.0:1788521937.909821:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 79 00000100:00100000:3.0:1788521937.909832:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5faec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+7:13745:x1875400799132928:12345-192.168.206.48@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788521937.912446:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5faec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+8:13745:x1875400799132928:12345-192.168.206.48@tcp:501:mount.lustre.0 Request processed in 2606us (2797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521937.912459:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 79 00000100:00100000:1.0:1788521937.916564:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521937.916655:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799133056 00000100:00100000:2.0:1788521937.916664:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799133056 00000100:00100000:2.0:1788521937.916723:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 80 00000100:00100000:2.0:1788521937.916732:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5faf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+8:13745:x1875400799133056:12345-192.168.206.48@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788521937.917104:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5faf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+8:13745:x1875400799133056:12345-192.168.206.48@tcp:503:mount.lustre.0 Request processed in 371us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521937.917113:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 80 00000100:00100000:0.0:1788521937.923436:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521937.923681:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799133184 00000100:00100000:3.0:1788521937.923695:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799133184 00000100:00100000:3.0:1788521937.923772:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 81 00000100:00100000:3.0:1788521937.923784:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+8:13763:x1875400799133184:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788521937.924420:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+8:13763:x1875400799133184:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 635us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521937.924431:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 81 00000100:00100000:1.0:1788521937.942728:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521937.942864:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799133312 00000100:00100000:3.0:1788521937.942877:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799133312 00000100:00100000:3.0:1788521937.942975:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 82 00000100:00100000:3.0:1788521937.942987:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+8:13763:x1875400799133312:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788521937.943358:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+8:13763:x1875400799133312:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 372us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521937.943367:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 82 00000100:00100000:1.0:1788521937.946813:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521937.947137:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799133440 00000100:00100000:2.0:1788521937.947194:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799133440 00000100:00100000:2.0:1788521937.947260:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 83 00000100:00100000:2.0:1788521937.947272:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f91649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+8:13745:x1875400799133440:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788521937.947294:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521937.947316:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996fb490ba00/0x1b7b50db5927cffe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00d67 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521937.947351:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fb490ba00/0x1b7b50db5927cffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d67 expref: 9 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521937.947365:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996fb490ba00/0x1b7b50db5927cffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d67 expref: 9 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521937.947376:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490ba00, rc 0) 00000100:00100000:2.0:1788521937.947455:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f91649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+9:13745:x1875400799133440:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 185us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521937.947463:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 83 00000100:00100000:0.0:1788521937.955924:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521937.956029:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799133568 00000100:00100000:3.0:1788521937.956061:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799133568 00000100:00100000:3.0:1788521937.956130:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 84 00000100:00100000:3.0:1788521937.956179:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f9164b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+9:13745:x1875400799133568:12345-192.168.206.48@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788521937.956212:0:14419:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788521937.956233:0:14419:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788521937.956238:0:14419:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788521937.956241:0:14419:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788521937.956243:0:14419:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788521937.958220:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f9164b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+9:13745:x1875400799133568:12345-192.168.206.48@tcp:256:mount.lustre.0 Request processed in 2067us (2300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521937.958249:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 84 00000100:00100000:1.0:1788521937.961774:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521937.961969:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799133696 00000100:00100000:3.0:1788521937.961981:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799133696 00000100:00100000:3.0:1788521937.962102:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 85 00000100:00100000:3.0:1788521937.962116:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad72a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+9:13745:x1875400799133696:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788521937.962185:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521937.962209:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f829d5000/0x1b7b50db5927d005 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00d6e expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521937.962247:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f829d5000/0x1b7b50db5927d005 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d6e expref: 10 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521937.962261:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f829d5000/0x1b7b50db5927d005 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d6e expref: 10 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521937.962273:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f829d5000, rc 0) 00000100:00100000:3.0:1788521937.962363:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad72a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+10:13745:x1875400799133696:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 251us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521937.962372:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 85 00000100:00100000:0.0:1788521937.965446:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521937.968239:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799133824 00000100:00100000:2.0:1788521937.968260:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799133824 00000100:00100000:2.0:1788521937.968365:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 86 00000100:00100000:2.0:1788521937.968378:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad72a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+10:13745:x1875400799133824:12345-192.168.206.48@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788521937.968796:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad72a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+10:13745:x1875400799133824:12345-192.168.206.48@tcp:501:mount.lustre.0 Request processed in 419us (3361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521937.968806:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 86 00000100:00100000:1.0:1788521937.971643:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521937.972668:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799133952 00000100:00100000:3.0:1788521937.972683:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799133952 00000100:00100000:3.0:1788521937.972783:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 87 00000100:00100000:3.0:1788521937.972795:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+10:13745:x1875400799133952:12345-192.168.206.48@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788521937.977502:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+10:13745:x1875400799133952:12345-192.168.206.48@tcp:503:mount.lustre.0 Request processed in 4692us (5855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521937.977521:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 87 00000100:00100000:1.0:1788521937.980551:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521937.981457:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799134080 00000100:00100000:3.0:1788521937.981472:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799134080 00000100:00100000:2.0:1788521937.981845:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 88 00000100:00100000:2.0:1788521937.981859:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad72b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+10:13767:x1875400799134080:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788521937.982648:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad72b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+10:13767:x1875400799134080:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 787us (2106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521937.982661:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 88 00000100:00100000:0.0:1788521937.987292:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521937.987660:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799134208 00000100:00100000:2.0:1788521937.987674:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799134208 00000100:00100000:2.0:1788521937.987746:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 89 00000100:00100000:2.0:1788521937.987758:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad72ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+10:13767:x1875400799134208:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788521937.991126:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad72ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+10:13767:x1875400799134208:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 3352us (3829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521937.991164:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 89 00000100:00100000:1.0:1788521937.999486:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521938.003993:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799134336 00000100:00100000:3.0:1788521938.004086:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799134336 00000100:00100000:3.0:1788521938.004264:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:3.0:1788521938.004276:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2360:x1875400799134336:12345-192.168.206.48@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788521938.004322:0:14426:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f@192.168.206.48@tcp t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:3.0:1788521938.004382:0:14426:0:(genops.c:1385:class_connect()) connect: client 061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f, cookie 0x1b7b50db5927d00c 00000004:00100000:3.0:1788521938.004421:0:14426:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788521938.004428:0:14426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1788521938.060135:0:14426:0:(import.c:65:import_set_state_nolock()) ffff996fbfc54800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788521938.060270:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+6:2360:x1875400799134336:12345-192.168.206.48@tcp:38:mount.lustre.0 Request processed in 55993us (60802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521938.060357:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:1.0:1788521938.063512:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521938.063559:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521938.063632:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799134592 00000100:00100000:0.0:1788521938.063645:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799134592 00000100:00100000:0.0:1788521938.063725:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799134464 00000100:00100000:0.0:1788521938.063729:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799134464 00000100:00100000:0.0:1788521938.063751:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:0.0:1788521938.063761:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+7:13745:x1875400799134592:12345-192.168.206.48@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788521938.063821:0:14425:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:1.0:1788521938.063990:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521938.064211:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+7:13745:x1875400799134592:12345-192.168.206.48@tcp:41:mount.lustre.0 Request processed in 449us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521938.064220:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:0.0:1788521938.064247:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:0.0:1788521938.064255:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+6:0:x1875400799134464:12345-192.168.206.48@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788521938.064268:0:14425:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788521938.064306:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+6:0:x1875400799134464:12345-192.168.206.48@tcp:41:mount.lustre.0 Request processed in 52us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521938.064313:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:0.0:1788521938.067072:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521938.067227:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799134720 00000100:00100000:1.0:1788521938.067241:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799134720 00000100:00100000:1.0:1788521938.067401:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:1.0:1788521938.067413:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+6:13745:x1875400799134720:12345-192.168.206.48@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788521938.067567:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+6:13745:x1875400799134720:12345-192.168.206.48@tcp:40:mount.lustre.0 Request processed in 155us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521938.067575:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:1.0:1788521938.070804:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521938.070971:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521938.071122:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799134848 00000100:00100000:3.0:1788521938.071135:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799134848 00000100:00100000:3.0:1788521938.071278:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799134976 00000100:00100000:3.0:1788521938.071282:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799134976 00000100:00100000:3.0:1788521938.071381:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:3.0:1788521938.071392:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1875400799134848:12345-192.168.206.48@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788521938.071433:0:15106:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f@192.168.206.48@tcp t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:3.0:1788521938.071473:0:15106:0:(genops.c:1385:class_connect()) connect: client 061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f, cookie 0x1b7b50db5927d013 00002000:00100000:3.0:1788521938.071488:0:15106:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f/ffff996f913b3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788521938.071517:0:15106:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788521938.072936:0:15106:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788521938.072988:0:15106:0:(import.c:65:import_set_state_nolock()) ffff996f913b4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788521938.073295:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+6:2360:x1875400799134848:12345-192.168.206.48@tcp:8:mount.lustre.0 Request processed in 1893us (2495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521938.073327:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:3.0:1788521938.073367:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:3.0:1788521938.073374:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1875400799134976:12345-192.168.206.48@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788521938.073403:0:15106:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f@192.168.206.48@tcp t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:3.0:1788521938.073433:0:15106:0:(genops.c:1385:class_connect()) connect: client 061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f, cookie 0x1b7b50db5927d01a 00002000:00100000:3.0:1788521938.073446:0:15106:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f/ffff996f913b7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788521938.073471:0:15106:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788521938.073791:0:15106:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788521938.073812:0:15106:0:(import.c:65:import_set_state_nolock()) ffff996f913b3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788521938.073856:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+6:2360:x1875400799134976:12345-192.168.206.48@tcp:8:mount.lustre.0 Request processed in 480us (2885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521938.074193:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:2.0:1788521938.076458:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521938.076602:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799135104 00000100:00100000:0.0:1788521938.076613:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799135104 00000100:00100000:0.0:1788521938.076677:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:0.0:1788521938.076688:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad6fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+6:13745:x1875400799135104:12345-192.168.206.48@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788521938.079184:0:14428:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2405us 00000004:00200000:3.0:1788521938.095650:0:14428:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788521938.095815:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad6fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+6:13745:x1875400799135104:12345-192.168.206.48@tcp:33:mount.lustre.0 Request processed in 19121us (19360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521938.095833:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 0 00010000:00010000:2.0:1788521938.320124:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521938.328983:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521938.329254:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799135232 00000100:00100000:3.0:1788521938.329268:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799135232 00000100:00100000:3.0:1788521938.329363:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:3.0:1788521938.329377:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+6:13788:x1875400799135232:12345-192.168.206.48@tcp:101:mkdir.0 00010000:00010000:3.0:1788521938.329404:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521938.330988:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4000/0x1b7b50db5927d021 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00d98 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521938.331086:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5600/0x1b7b50db5927d028 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521938.331099:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5600/0x1b7b50db5927d028 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521938.331197:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5600/0x1b7b50db5927d028 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521938.331232:0:14427:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788521938.331236:0:14427:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788521938.331270:0:14427:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5600/0x1b7b50db5927d028 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521938.331298:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4000/0x1b7b50db5927d021 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d98 expref: 8 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521938.331318:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5600/0x1b7b50db5927d028 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d98 expref: 7 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521938.331327:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996f83d40d00) 00010000:00010000:3.0:1788521938.331330:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788521938.331333:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f829d5600, rc 0) 00000100:00100000:3.0:1788521938.332011:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+7:13788:x1875400799135232:12345-192.168.206.48@tcp:101:mkdir.0 Request processed in 2636us (3040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521938.332020:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 8 00010000:00010000:1.0:1788521939.342416:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788521939.351688:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f 00000100:00100000:0.0:1788521940.303572:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1e22794d-c642-4031-a520-725ebfafbfe5:3304:1875400816951680:0@lo:400:kworker.0 00000100:00100000:0.0:1788521940.303677:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521940.303765:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875400816952192:0@lo:400:kworker.0 00000100:00100000:0.0:1788521940.303795:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521940.303848:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788521940.303854:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816951808:0@lo:400:kworker.0 00000100:00100000:0.0:1788521940.303881:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521940.303897:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875400816952320:0@lo:400:kworker.0 00000100:00100000:0.0:1788521940.303918:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521940.303958:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816952192 00000100:00100000:0.0:1788521940.303968:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816952192 00000100:00100000:1.0:1788521940.304399:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816951936:0@lo:400:kworker.0 00000100:00100000:1.0:1788521940.304436:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521940.304459:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788521940.304465:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875400816952064:0@lo:400:kworker.0 00000100:00100000:1.0:1788521940.304486:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521940.304531:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816952064 00000100:00100000:1.0:1788521940.304535:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816952064 00000100:00100000:1.0:1788521940.304564:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788521940.304574:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875400816952192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521940.304636:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875400816952192:12345-0@lo:400:kworker.0 Request processed in 63us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521940.304644:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788521940.304664:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788521940.304669:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875400816952064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521940.304697:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875400816952064:12345-0@lo:400:kworker.0 Request processed in 28us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521940.304703:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788521940.304721:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521940.304734:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816951808 00000100:00100000:1.0:1788521940.304738:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816951808 00000100:00100000:1.0:1788521940.304767:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816951936 00000100:00100000:1.0:1788521940.304770:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816951936 00000100:00100000:1.0:1788521940.304784:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788521940.304790:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816951808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521940.305053:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816951808:12345-0@lo:400:kworker.0 Request processed in 263us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521940.305061:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788521940.305075:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788521940.305082:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816951936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521940.305111:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816951936:12345-0@lo:400:kworker.0 Request processed in 30us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521940.305117:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788521940.305167:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788521940.305171:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521940.305210:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875400816952064:0@lo:400:kworker.0 00000100:00100000:1.0:1788521940.305229:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816951936:0@lo:400:kworker.0 00000100:00100000:0.0:1788521940.305236:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816952320 00000100:00100000:0.0:1788521940.305252:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816952320 00000100:00100000:1.0:1788521940.305276:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816951808:0@lo:400:kworker.0 00000100:00100000:1.0:1788521940.305300:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875400816952192:0@lo:400:kworker.0 00000100:00080000:1.0:1788521940.305357:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521940.305365:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788521940.305556:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875400816952320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521940.305655:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875400816952320:12345-0@lo:400:kworker.0 Request processed in 279us (1735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521940.305663:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788521940.308169:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788521940.308204:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f860dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816952448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521940.308317:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521940.308392:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816952448 00000100:00100000:3.0:1788521940.308405:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816952448 00000100:00100000:3.0:1788521940.308467:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788521940.308477:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816952448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788521940.308523:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521940.308572:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816952448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521940.308579:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788521940.308634:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f860dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816952448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521940.308783:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f812eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816952576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521940.308861:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521940.308994:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875400816952320:0@lo:400:kworker.0 00000100:00100000:3.0:1788521940.309010:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816952576 00000100:00100000:3.0:1788521940.309018:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816952576 00000100:00100000:3.0:1788521940.309263:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788521940.309270:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816951680 00000100:00100000:3.0:1788521940.309279:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816952576:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521940.309281:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816951680 00002000:00000024:3.0:1788521940.309321:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521940.309328:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788521940.309340:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+19:3304:x1875400816951680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521940.309381:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816952576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521940.309390:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788521940.309426:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+19:3304:x1875400816951680:12345-0@lo:400:kworker.0 Request processed in 87us (5748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521940.309437:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788521940.309502:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1e22794d-c642-4031-a520-725ebfafbfe5:3304:1875400816951680:0@lo:400:kworker.0 00000100:00100000:2.0:1788521940.309533:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f812eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816952576:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788521940.366732:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521940.494794:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521940.495057:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799135360 00000100:00100000:2.0:1788521940.495070:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799135360 00000100:00100000:2.0:1788521940.495205:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:2.0:1788521940.495218:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+7:13840:x1875400799135360:12345-192.168.206.48@tcp:41:lfs.0 00000004:00000024:2.0:1788521940.495278:0:14426:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788521940.495401:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+7:13840:x1875400799135360:12345-192.168.206.48@tcp:41:lfs.0 Request processed in 185us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521940.495409:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00080000:1.0:1788521940.495952:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521940.501255:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521940.502106:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799135488 00000100:00100000:1.0:1788521940.502121:0:15111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799135488 00000100:00100000:1.0:1788521940.502255:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:1.0:1788521940.502267:0:15111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad6fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+6:13840:x1875400799135488:12345-192.168.206.48@tcp:13:lfs.0 00002000:00000024:1.0:1788521940.502314:0:15111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521940.502442:0:15111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad6fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+6:13840:x1875400799135488:12345-192.168.206.48@tcp:13:lfs.0 Request processed in 176us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521940.502450:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00080000:2.0:1788521940.505451:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521940.509457:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521940.510413:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799135616 00000100:00100000:1.0:1788521940.510429:0:15111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799135616 00000100:00100000:1.0:1788521940.510597:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:1.0:1788521940.510609:0:15111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+5:13840:x1875400799135616:12345-192.168.206.48@tcp:13:lfs.0 00002000:00000024:1.0:1788521940.510643:0:15111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521940.510770:0:15111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+5:13840:x1875400799135616:12345-192.168.206.48@tcp:13:lfs.0 Request processed in 162us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521940.510796:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00080000:2.0:1788521940.516371:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788521940.793453:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521940.793530:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799135744 00000100:00100000:3.0:1788521940.793539:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799135744 00000100:00100000:3.0:1788521940.793593:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 91 00000100:00100000:3.0:1788521940.793605:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad72bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+10:13873:x1875400799135744:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788521940.793624:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521940.793653:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996f829d4000/0x1b7b50db5927d02f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00d9f expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521940.793685:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996f829d4000/0x1b7b50db5927d02f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d9f expref: 11 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521940.793696:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996f829d4000/0x1b7b50db5927d02f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d9f expref: 11 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521940.793706:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f829d4000, rc 0) 00000100:00100000:3.0:1788521940.793773:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad72bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+11:13873:x1875400799135744:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 169us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521940.793779:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 91 00000100:00100000:0.0:1788521940.810477:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521940.810578:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799135872 00000100:00100000:2.0:1788521940.810587:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799135872 00000100:00100000:2.0:1788521940.810643:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 92 00000100:00100000:2.0:1788521940.810653:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad72b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+11:13873:x1875400799135872:12345-192.168.206.48@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788521940.815996:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad72b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+11:13873:x1875400799135872:12345-192.168.206.48@tcp:501:mount.lustre.0 Request processed in 5331us (5515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521940.816021:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 92 00000100:00100000:1.0:1788521940.818306:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521940.818433:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799136000 00000100:00100000:0.0:1788521940.818442:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799136000 00000100:00100000:0.0:1788521940.818493:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 93 00000100:00100000:0.0:1788521940.818503:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+11:13873:x1875400799136000:12345-192.168.206.48@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788521940.818721:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+11:13873:x1875400799136000:12345-192.168.206.48@tcp:503:mount.lustre.0 Request processed in 218us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521940.818729:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 93 00000100:00100000:0.0:1788521940.832344:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521940.833662:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799136128 00000100:00100000:2.0:1788521940.833675:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799136128 00000100:00100000:2.0:1788521940.833737:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 94 00000100:00100000:2.0:1788521940.833747:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad72a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+11:13878:x1875400799136128:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788521940.834116:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad72a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+11:13878:x1875400799136128:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 368us (1779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521940.834125:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 94 00000100:00100000:2.0:1788521940.861549:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521940.865253:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799136256 00000100:00100000:3.0:1788521940.865268:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799136256 00000100:00100000:3.0:1788521940.865340:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 95 00000100:00100000:3.0:1788521940.865352:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad728850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+11:13878:x1875400799136256:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788521940.865646:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad728850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+11:13878:x1875400799136256:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 296us (4105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521940.865655:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 95 00000100:00100000:1.0:1788521940.874733:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521940.878238:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799136384 00000100:00100000:0.0:1788521940.878254:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799136384 00000100:00100000:1.0:1788521940.878594:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 96 00000100:00100000:1.0:1788521940.878608:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+11:13873:x1875400799136384:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788521940.878625:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521940.878643:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996fbc6d5e00/0x1b7b50db5927d036 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00dc9 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521940.878676:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fbc6d5e00/0x1b7b50db5927d036 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00dc9 expref: 12 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521940.878688:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996fbc6d5e00/0x1b7b50db5927d036 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00dc9 expref: 12 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521940.878698:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d5e00, rc 0) 00000100:00100000:1.0:1788521940.878765:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+12:13873:x1875400799136384:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 161us (4040us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521940.878772:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 96 00000100:00100000:0.0:1788521940.881574:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521940.881841:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799136512 00000100:00100000:2.0:1788521940.881864:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799136512 00000100:00100000:2.0:1788521940.881927:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 97 00000100:00100000:2.0:1788521940.881938:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+12:13873:x1875400799136512:12345-192.168.206.48@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788521940.881961:0:14420:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788521940.881983:0:14420:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788521940.881988:0:14420:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788521940.881990:0:14420:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788521940.881993:0:14420:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788521940.885754:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+12:13873:x1875400799136512:12345-192.168.206.48@tcp:256:mount.lustre.0 Request processed in 3808us (4178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521940.885770:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 97 00000100:00100000:1.0:1788521940.890465:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521940.890563:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799136640 00000100:00100000:2.0:1788521940.890573:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799136640 00000100:00100000:2.0:1788521940.890630:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 98 00000100:00100000:2.0:1788521940.890639:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+12:13873:x1875400799136640:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788521940.890655:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521940.890672:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996fb490b600/0x1b7b50db5927d03d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00dd0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521940.890715:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fb490b600/0x1b7b50db5927d03d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00dd0 expref: 13 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521940.890726:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996fb490b600/0x1b7b50db5927d03d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00dd0 expref: 13 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521940.890735:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490b600, rc 0) 00000100:00100000:2.0:1788521940.890795:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+13:13873:x1875400799136640:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 157us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521940.890803:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 98 00000100:00100000:1.0:1788521940.896212:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521940.896618:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799136768 00000100:00100000:0.0:1788521940.896629:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799136768 00000100:00100000:0.0:1788521940.896683:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 99 00000100:00100000:0.0:1788521940.896693:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad72b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+13:13873:x1875400799136768:12345-192.168.206.48@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788521940.897023:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad72b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+13:13873:x1875400799136768:12345-192.168.206.48@tcp:501:mount.lustre.0 Request processed in 329us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521940.897031:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 99 00000100:00100000:0.0:1788521940.905253:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521940.905505:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799136896 00000100:00100000:3.0:1788521940.905514:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799136896 00000100:00100000:3.0:1788521940.905567:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 100 00000100:00100000:3.0:1788521940.905576:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+13:13873:x1875400799136896:12345-192.168.206.48@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788521940.905834:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+13:13873:x1875400799136896:12345-192.168.206.48@tcp:503:mount.lustre.0 Request processed in 258us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521940.905842:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 100 00000100:00100000:1.0:1788521940.915486:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521940.915758:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799137024 00000100:00100000:2.0:1788521940.915768:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799137024 00000100:00100000:2.0:1788521940.915813:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 101 00000100:00100000:2.0:1788521940.915832:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+13:13883:x1875400799137024:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788521940.916068:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+13:13883:x1875400799137024:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 246us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521940.916076:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 101 00000100:00100000:1.0:1788521940.930106:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521940.930226:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799137152 00000100:00100000:0.0:1788521940.930235:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799137152 00000100:00100000:0.0:1788521940.930296:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 102 00000100:00100000:0.0:1788521940.930306:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+13:13883:x1875400799137152:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788521940.930539:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+13:13883:x1875400799137152:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 234us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521940.930548:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 102 00000100:00100000:0.0:1788521940.961333:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521940.961371:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521940.961408:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521940.961468:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521940.962007:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799137280 00000100:00100000:2.0:1788521940.962018:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799137280 00000100:00100000:2.0:1788521940.962060:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799137664 00000100:00100000:2.0:1788521940.962063:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799137664 00000100:00100000:2.0:1788521940.962091:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:2.0:1788521940.962101:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+7:2364:x1875400799137664:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521940.962199:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+7:2364:x1875400799137664:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 99us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521940.962222:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:2.0:1788521940.962241:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:2.0:1788521940.962246:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2360:x1875400799137280:12345-192.168.206.48@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788521940.962269:0:14426:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from aa516df2-6a20-4ac4-9ce7-f7e9e546f820@192.168.206.48@tcp t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:2.0:1788521940.962301:0:14426:0:(genops.c:1385:class_connect()) connect: client aa516df2-6a20-4ac4-9ce7-f7e9e546f820, cookie 0x1b7b50db5927d044 00000004:00100000:2.0:1788521940.962330:0:14426:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788521940.962440:0:14426:0:(import.c:65:import_set_state_nolock()) ffff996f913e6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788521940.962470:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+6:2360:x1875400799137280:12345-192.168.206.48@tcp:38:mount.lustre.0 Request processed in 222us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521940.962478:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:1.0:1788521940.962600:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799137792 00000100:00100000:1.0:1788521940.962605:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799137792 00000100:00100000:1.0:1788521940.962641:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799137920 00000100:00100000:1.0:1788521940.962644:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799137920 00000100:00100000:1.0:1788521940.962671:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:1.0:1788521940.962677:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+6:2363:x1875400799137792:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521940.962706:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+6:2363:x1875400799137792:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 29us (1298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521940.962713:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:1.0:1788521940.962726:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:1.0:1788521940.962732:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+5:2364:x1875400799137920:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521940.962756:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+5:2364:x1875400799137920:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 25us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521940.962763:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:1.0:1788521940.968581:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521940.968666:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521940.969307:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799137408 00000100:00100000:0.0:1788521940.969328:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799137408 00000100:00100000:0.0:1788521940.969392:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799137536 00000100:00100000:0.0:1788521940.969395:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799137536 00000100:00100000:0.0:1788521940.969413:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:0.0:1788521940.969421:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+7:0:x1875400799137408:12345-192.168.206.48@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788521940.969452:0:14425:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788521940.969517:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+7:0:x1875400799137408:12345-192.168.206.48@tcp:41:mount.lustre.0 Request processed in 95us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521940.969525:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:0.0:1788521940.969544:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:0.0:1788521940.969551:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+6:13873:x1875400799137536:12345-192.168.206.48@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788521940.969561:0:14425:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788521940.969583:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+6:13873:x1875400799137536:12345-192.168.206.48@tcp:41:mount.lustre.0 Request processed in 33us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521940.969590:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00080000:1.0:1788521940.970364:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521940.977104:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521940.977694:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799138048 00000100:00100000:0.0:1788521940.977704:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799138048 00000100:00100000:0.0:1788521940.977770:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:0.0:1788521940.977781:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+6:13873:x1875400799138048:12345-192.168.206.48@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788521940.977883:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+6:13873:x1875400799138048:12345-192.168.206.48@tcp:40:mount.lustre.0 Request processed in 104us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521940.978175:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:0.0:1788521940.981650:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521940.981695:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521940.981738:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521940.981890:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799138432 00000100:00100000:1.0:1788521940.981900:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799138432 00000100:00100000:1.0:1788521940.981954:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:1.0:1788521940.981966:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+6:13873:x1875400799138432:12345-192.168.206.48@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788521940.982040:0:14429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788521940.982119:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+6:13873:x1875400799138432:12345-192.168.206.48@tcp:33:mount.lustre.0 Request processed in 155us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521940.982126:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:3.0:1788521940.982838:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799138176 00000100:00100000:3.0:1788521940.982855:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799138176 00000100:00100000:3.0:1788521940.982893:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799138304 00000100:00100000:3.0:1788521940.982896:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799138304 00000100:00100000:3.0:1788521940.982911:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:3.0:1788521940.982917:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1875400799138176:12345-192.168.206.48@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788521940.982942:0:15108:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from aa516df2-6a20-4ac4-9ce7-f7e9e546f820@192.168.206.48@tcp t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:3.0:1788521940.982975:0:15108:0:(genops.c:1385:class_connect()) connect: client aa516df2-6a20-4ac4-9ce7-f7e9e546f820, cookie 0x1b7b50db5927d04b 00002000:00100000:3.0:1788521940.982988:0:15108:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli aa516df2-6a20-4ac4-9ce7-f7e9e546f820/ffff996f913b4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788521940.982999:0:15108:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788521940.983114:0:15108:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788521940.983168:0:15108:0:(import.c:65:import_set_state_nolock()) ffff996f913b2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788521940.983215:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+6:2360:x1875400799138176:12345-192.168.206.48@tcp:8:mount.lustre.0 Request processed in 296us (1519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521940.983222:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:3.0:1788521940.983238:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:3.0:1788521940.983243:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1875400799138304:12345-192.168.206.48@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788521940.983258:0:15108:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from aa516df2-6a20-4ac4-9ce7-f7e9e546f820@192.168.206.48@tcp t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:3.0:1788521940.983288:0:15108:0:(genops.c:1385:class_connect()) connect: client aa516df2-6a20-4ac4-9ce7-f7e9e546f820, cookie 0x1b7b50db5927d052 00002000:00100000:3.0:1788521940.983294:0:15108:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli aa516df2-6a20-4ac4-9ce7-f7e9e546f820/ffff996f913b0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788521940.983300:0:15108:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788521940.983486:0:15108:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788521940.983502:0:15108:0:(import.c:65:import_set_state_nolock()) ffff996f913b5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788521940.983528:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+6:2360:x1875400799138304:12345-192.168.206.48@tcp:8:mount.lustre.0 Request processed in 284us (1789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521940.983552:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:0.0:1788521941.203542:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521941.203939:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799138560 00000100:00100000:1.0:1788521941.203949:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799138560 00000100:00100000:1.0:1788521941.204006:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:1.0:1788521941.204017:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+6:13904:x1875400799138560:12345-192.168.206.48@tcp:101:mkdir.0 00010000:00010000:1.0:1788521941.204043:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521941.204067:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927d059 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00dfa expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521941.204129:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927d060 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521941.204168:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927d060 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521941.204183:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927d060 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521941.204216:0:14426:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788521941.204220:0:14426:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521941.204239:0:14426:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927d060 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521941.204277:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4400/0x1b7b50db5927d059 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00dfa expref: 8 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521941.204295:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927d060 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00dfa expref: 7 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521941.204303:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996f83d40d00) 00010000:00010000:1.0:1788521941.204306:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788521941.204309:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d5c00, rc 0) 00000100:00100000:1.0:1788521941.204611:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+7:13904:x1875400799138560:12345-192.168.206.48@tcp:101:mkdir.0 Request processed in 594us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521941.204628:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 14 00010000:00010000:1.0:1788521941.391244:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788521941.906378:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aa516df2-6a20-4ac4-9ce7-f7e9e546f820 00000001:00100000:2.0:1788521941.906395:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f 00010000:00010000:1.0:1788521942.416610:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788521943.422454:0:5856:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f 00000001:00100000:0.0:1788521943.422474:0:5856:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of aa516df2-6a20-4ac4-9ce7-f7e9e546f820 00010000:00010000:1.0:1788521943.439414:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788521943.838419:0:16384:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1788521944.442191:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aa516df2-6a20-4ac4-9ce7-f7e9e546f820 00010000:00010000:0.0:1788521944.462628:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521945.422352:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1e22794d-c642-4031-a520-725ebfafbfe5:3304:1875400816952704:0@lo:400:kworker.0 00000100:00100000:2.0:1788521945.422433:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521945.422487:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875400816953216:0@lo:400:kworker.0 00000100:00100000:2.0:1788521945.422523:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521945.422551:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788521945.422558:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816952832:0@lo:400:kworker.0 00000100:00100000:2.0:1788521945.422582:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521945.422613:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875400816953344:0@lo:400:kworker.0 00000100:00100000:2.0:1788521945.422642:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521945.422677:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816952960:0@lo:400:kworker.0 00000100:00100000:2.0:1788521945.422700:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521945.422731:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788521945.422737:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fad6fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875400816953088:0@lo:400:kworker.0 00000100:00100000:2.0:1788521945.422759:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521945.422791:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816952704 00000100:00100000:2.0:1788521945.422807:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816952704 00000100:00100000:2.0:1788521945.422990:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788521945.423001:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+19:3304:x1875400816952704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521945.424850:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816952832 00000100:00100000:3.0:1788521945.424862:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816952832 00000100:00100000:3.0:1788521945.424913:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816952960 00000100:00100000:3.0:1788521945.424917:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816952960 00000100:00100000:3.0:1788521945.424934:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788521945.424942:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad6fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816952832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521945.425025:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad6fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816952832:12345-0@lo:400:kworker.0 Request processed in 72us (2430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521945.425033:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788521945.425050:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788521945.425057:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad6fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816952960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521945.425086:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad6fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816952960:12345-0@lo:400:kworker.0 Request processed in 30us (2385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521945.425091:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788521945.425107:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788521945.425110:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521945.427163:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816953216 00000100:00100000:1.0:1788521945.427175:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816953216 00000100:00100000:2.0:1788521945.428545:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+19:3304:x1875400816952704:12345-0@lo:400:kworker.0 Request processed in 5540us (6106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521945.428557:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788521945.428670:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816953600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521945.428720:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521945.428756:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788521945.428763:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816953472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521945.428786:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521945.428840:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816953600 00000100:00100000:2.0:1788521945.428846:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816953600 00000100:00100000:2.0:1788521945.428871:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816953472 00000100:00100000:2.0:1788521945.428873:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816953472 00000100:00100000:2.0:1788521945.428886:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788521945.428893:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82f9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816953600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788521945.428922:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521945.428955:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82f9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816953600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521945.428961:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788521945.428974:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788521945.428980:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82f9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816953472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788521945.429005:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521945.429041:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82f9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816953472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521945.429047:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788521945.429086:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816953472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521945.429100:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816953600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521945.429131:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816952960:0@lo:400:kworker.0 00000100:00100000:2.0:1788521945.429176:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816952832:0@lo:400:kworker.0 00000100:00100000:2.0:1788521945.429186:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1e22794d-c642-4031-a520-725ebfafbfe5:3304:1875400816952704:0@lo:400:kworker.0 00000100:00100000:0.0:1788521945.430287:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816953344 00000100:00100000:0.0:1788521945.430295:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816953344 00000100:00100000:1.0:1788521945.431696:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816953088 00000100:00100000:1.0:1788521945.431706:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816953088 00000100:00100000:0.0:1788521945.436692:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788521945.436710:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad6fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875400816953216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521945.436815:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad6fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875400816953216:12345-0@lo:400:kworker.0 Request processed in 112us (14291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521945.436822:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788521945.437541:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788521945.437557:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad6fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875400816953344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521945.437607:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad6fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875400816953344:12345-0@lo:400:kworker.0 Request processed in 57us (14964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521945.437615:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788521945.438120:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788521945.438130:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad6ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875400816953088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521945.438194:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad6ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875400816953088:12345-0@lo:400:kworker.0 Request processed in 66us (15433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521945.438201:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788521945.438272:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875400816953344:0@lo:400:kworker.0 00000100:00100000:0.0:1788521945.438285:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875400816953216:0@lo:400:kworker.0 00000100:00100000:0.0:1788521945.438324:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fad6fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875400816953088:0@lo:400:kworker.0 00000100:00080000:1.0:1788521945.438736:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788521945.492773:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521946.383069:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521946.383115:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521946.383131:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799138688 00000100:00100000:1.0:1788521946.383170:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799138688 00000100:00100000:2.0:1788521946.383180:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521946.383204:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521946.383225:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 104 00000100:00100000:2.0:1788521946.383231:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521946.383240:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+13:2363:x1875400799138688:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521946.383252:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521946.383277:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521946.383308:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+13:2363:x1875400799138688:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 71us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521946.383317:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 104 00000100:00100000:3.0:1788521946.383324:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799138944 00000100:00100000:3.0:1788521946.383331:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799138944 00000100:00080000:1.0:1788521946.383357:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521946.383371:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799139456 00000100:00100000:3.0:1788521946.383375:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799139456 00000100:00100000:3.0:1788521946.383400:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799139072 00000100:00100000:3.0:1788521946.383403:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799139072 00000100:00100000:3.0:1788521946.383417:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799139328 00000100:00100000:3.0:1788521946.383420:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799139328 00000100:00100000:3.0:1788521946.383433:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:3.0:1788521946.383441:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82f9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+5:2363:x1875400799138944:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521946.383492:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799139200 00000100:00100000:0.0:1788521946.383496:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799139200 00000100:00100000:0.0:1788521946.383524:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799138816 00000100:00100000:0.0:1788521946.383527:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799138816 00000100:00100000:0.0:1788521946.383544:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:0.0:1788521946.383550:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+6:2363:x1875400799139200:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521946.387554:0:15107:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788521946.387569:0:15107:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:2.0:1788521946.387609:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788521946.387615:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788521946.387618:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521946.388812:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:2.0:1788521946.388830:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+5:2363:x1875400799139456:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521946.388901:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+5:2363:x1875400799139456:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 78us (5696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521946.388924:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:2.0:1788521946.388948:0:15107:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788521946.388957:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:2.0:1788521946.388963:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+5:2363:x1875400799139072:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521946.388991:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+5:2363:x1875400799139072:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 28us (5740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521946.388997:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:2.0:1788521946.389008:0:15107:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788521946.389014:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:2.0:1788521946.389021:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+5:2363:x1875400799139328:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521946.389043:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+5:2363:x1875400799139328:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 23us (5766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521946.389049:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:2.0:1788521946.389174:0:14425:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788521946.389182:0:14425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788521946.389406:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:2.0:1788521946.389416:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82f9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+6:2363:x1875400799138816:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521946.389448:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82f9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+6:2363:x1875400799138816:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 34us (6221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521946.389455:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:0.0:1788521946.391407:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+6:2363:x1875400799139200:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 7847us (8218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521946.391427:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:3.0:1788521946.392641:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82f9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+5:2363:x1875400799138944:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 9193us (9519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521946.392679:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 6 00010000:00010000:1.0:1788521946.510405:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788521946.897640:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:2.0:1788521947.175773:0:16537:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff24423c60 20000000:00000080:2.0:1788521947.175799:0:16537:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff996faea16000 uarg=0000000000000000 20000000:01000000:2.0:1788521947.175940:0:16537:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788521947.175946:0:16537:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788521947.175955:0:16537:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788521947.176796:0:16538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1788521947.177019:0:16537:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788521947.183726:0:16537:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788521947.183754:0:16537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996fb490ae00/0x1b7b50db5927d067 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521947.183771:0:16537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996fbc6d4c00/0x1b7b50db5927cd5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927cd57 expref: 18 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521947.183779:0:16537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996f8392c000/0x1b7b50db5927cdab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927cda4 expref: 18 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521947.183796:0:16537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996f8392de00/0x1b7b50db5927ce1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927ce14 expref: 18 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521947.183805:0:16537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996f829d5000/0x1b7b50db5927d005 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d6e expref: 12 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521947.183812:0:16537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996fb490b600/0x1b7b50db5927d03d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00dd0 expref: 12 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521947.183874:0:16537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996fb490ae00/0x1b7b50db5927d067 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521947.183915:0:16537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996fb490b600/0x1b7b50db5927d03d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00dd0 expref: 12 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521947.183936:0:16537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996fb490b600/0x1b7b50db5927d03d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00dd0 expref: 12 pid: 14418 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521947.183949:0:16537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82f9ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16537:1875400816953728:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788521947.186070:0:16537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996f829d5000/0x1b7b50db5927d005 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d6e expref: 12 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521947.186087:0:16537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996f829d5000/0x1b7b50db5927d005 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d6e expref: 12 pid: 14418 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521947.186102:0:16537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82a60000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16537:1875400816953856:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788521947.187567:0:16537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996f8392de00/0x1b7b50db5927ce1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927ce14 expref: 18 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521947.187582:0:16537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996f8392de00/0x1b7b50db5927ce1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927ce14 expref: 18 pid: 14420 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521947.187595:0:16537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82a61c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16537:1875400816953984:0@lo:104: 00000100:00100000:3.0:1788521947.187637:0:16537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788521947.187716:0:16537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996f8392c000/0x1b7b50db5927cdab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927cda4 expref: 18 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521947.187725:0:16537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996f8392c000/0x1b7b50db5927cdab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927cda4 expref: 18 pid: 14420 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521947.187733:0:16537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82a60e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16537:1875400816954112:0@lo:104: 00000100:00100000:3.0:1788521947.187757:0:16537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521947.188748:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521947.188807:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799139584 00000100:00100000:1.0:1788521947.188825:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799139584 00010000:00010000:1.0:1788521947.188859:0:14410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996fb490b600/0x1b7b50db5927d03d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00dd0 expref: 13 pid: 14418 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521947.188890:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:1.0:1788521947.188898:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+13:2364:x1875400799139584:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521947.188910:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521947.188914:0:14410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996fb490b600/0x1b7b50db5927d03d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00dd0 expref: 13 pid: 14418 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521947.188931:0:14410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996fb490b600/0x1b7b50db5927d03d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00dd0 expref: 13 pid: 14418 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521947.188947:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521947.188982:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+13:2364:x1875400799139584:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 85us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521947.188989:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 4 00010000:00010000:3.0:1788521947.189516:0:16537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996fbc6d4c00/0x1b7b50db5927cd5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b7b50db5927cd57 expref: 18 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521947.189527:0:16537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996fbc6d4c00/0x1b7b50db5927cd5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b7b50db5927cd57 expref: 18 pid: 14418 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521947.189547:0:16537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82a60700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16537:1875400816954240:0@lo:104: 00000100:00100000:3.0:1788521947.189582:0:16537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521947.190053:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816953984 00000100:00100000:2.0:1788521947.190061:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816953984 00000100:00100000:2.0:1788521947.190097:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816954112 00000100:00100000:2.0:1788521947.190099:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816954112 00000100:00100000:2.0:1788521947.190123:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788521947.190131:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1e22794d-c642-4031-a520-725ebfafbfe5+4:16537:x1875400816953984:12345-0@lo:104: 00010000:00010000:2.0:1788521947.190160:0:14408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996fb490bc00/0x1b7b50db5927ce14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927ce1b expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521947.190437:0:16537:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86583600 going to sleep for 11 seconds 00010000:00010000:3.0:1788521947.190461:0:16537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996fb490b600/0x1b7b50db5927d03d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00dd0 expref: 12 pid: 14418 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521947.190477:0:16537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82f9ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16537:1875400816953728:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788521947.190489:0:16537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82a61c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16537:1875400816953984:0@lo:104: 00010000:00010000:2.0:1788521947.191732:0:14408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788521947.191747:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1e22794d-c642-4031-a520-725ebfafbfe5+4:16537:x1875400816953984:12345-0@lo:104: Request processed in 1614us (4107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521947.191756:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788521947.191806:0:14408:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1788521947.191934:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521947.191943:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996fb490bc00/0x1b7b50db5927ce14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927ce1b expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.191951:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490bc00 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:0.0:1788521947.191955:0:14413:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996fb490bc00/0x1b7b50db5927ce14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927ce1b expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.191964:0:14413:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996fb490bc00/0x1b7b50db5927ce14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927ce1b expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521947.191971:0:14413:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996fb490bc00/0x1b7b50db5927ce14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927ce1b expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521947.191977:0:14413:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788521947.192029:0:14413:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996fb490bc00/0x1b7b50db5927ce14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927ce1b expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.192036:0:14413:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521947.192061:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996fb490bc00/0x1b7b50db5927ce14 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927ce1b expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.192067:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996fb490bc00/0x1b7b50db5927ce14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927ce1b expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.192079:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521947.192081:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521947.192082:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521947.192097:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1e22794d-c642-4031-a520-725ebfafbfe5:3304:1875400816954368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521947.192209:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521947.192973:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816954368 00000100:00100000:0.0:1788521947.192982:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816954368 00010000:00010000:0.0:1788521947.193014:0:14411:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996f8392de00/0x1b7b50db5927ce1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927ce14 expref: 19 pid: 14420 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521947.193050:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788521947.193059:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e22794d-c642-4031-a520-725ebfafbfe5+19:3304:x1875400816954368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521947.193070:0:14411:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521947.193075:0:14411:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996f8392de00/0x1b7b50db5927ce1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927ce14 expref: 19 pid: 14420 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.193084:0:14411:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996f8392de00/0x1b7b50db5927ce1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927ce14 expref: 19 pid: 14420 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.193098:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8392de00/0x1b7b50db5927ce1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927ce14 expref: 19 pid: 14420 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.193198:0:14411:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521947.193366:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e22794d-c642-4031-a520-725ebfafbfe5+18:3304:x1875400816954368:12345-0@lo:103:ldlm_bl.0 Request processed in 308us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521947.193375:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788521947.193414:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1e22794d-c642-4031-a520-725ebfafbfe5:3304:1875400816954368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521947.193760:0:16537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82a60000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16537:1875400816953856:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788521947.193897:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816954240 00000100:00100000:2.0:1788521947.193902:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816954240 00000100:00100000:2.0:1788521947.193929:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788521947.193937:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1e22794d-c642-4031-a520-725ebfafbfe5+4:16537:x1875400816954112:12345-0@lo:104: 00010000:00010000:2.0:1788521947.193949:0:14408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5200/0x1b7b50db5927cda4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927cdab expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521947.194008:0:14408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788521947.194013:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1e22794d-c642-4031-a520-725ebfafbfe5+4:16537:x1875400816954112:12345-0@lo:104: Request processed in 78us (6256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521947.194019:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788521947.194034:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788521947.194039:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad6fa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1e22794d-c642-4031-a520-725ebfafbfe5+3:16537:x1875400816954240:12345-0@lo:104: 00010000:00010000:2.0:1788521947.194048:0:14408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff996f8392c800/0x1b7b50db5927cd57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927cd5e expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521947.194092:0:14408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788521947.194097:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad6fa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1e22794d-c642-4031-a520-725ebfafbfe5+3:16537:x1875400816954240:12345-0@lo:104: Request processed in 58us (4514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521947.194103:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788521947.194470:0:16537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82a60e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16537:1875400816954112:0@lo:104: 00000100:00100000:3.0:1788521947.194480:0:16537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82a60700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16537:1875400816954240:0@lo:104: 00010000:00010000:3.0:1788521947.194510:0:16537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996fb490ae00/0x1b7b50db5927d067 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521947.195222:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00010000:00010000:0.0:1788521947.195457:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788521947.195464:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5200/0x1b7b50db5927cda4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927cdab expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.195471:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5200 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:0.0:1788521947.195475:0:14414:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5200/0x1b7b50db5927cda4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927cdab expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.195497:0:14414:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5200/0x1b7b50db5927cda4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927cdab expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521947.195504:0:14414:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5200/0x1b7b50db5927cda4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927cdab expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521947.195510:0:14414:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788521947.195549:0:14414:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5200/0x1b7b50db5927cda4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927cdab expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.195556:0:14414:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521947.195575:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5200/0x1b7b50db5927cda4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927cdab expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.195582:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996fbc6d5200/0x1b7b50db5927cda4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927cdab expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.195597:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521947.195600:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff996f8392c800/0x1b7b50db5927cd57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b7b50db5927cd5e expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.195605:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f8392c800 already unused, calling callback (ffffffffc1cbec20) 10000000:00010000:0.0:1788521947.195608:0:14414:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff996f8392c800/0x1b7b50db5927cd57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b7b50db5927cd5e expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.195615:0:14414:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff996f8392c800/0x1b7b50db5927cd57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b7b50db5927cd5e expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521947.195621:0:14414:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff996f8392c800/0x1b7b50db5927cd57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b7b50db5927cd5e expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521947.195633:0:14414:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788521947.195648:0:14414:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff996f8392c800/0x1b7b50db5927cd57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927cd5e expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.195654:0:14414:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521947.195668:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff996f8392c800/0x1b7b50db5927cd57 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927cd5e expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.195674:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff996f8392c800/0x1b7b50db5927cd57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b7b50db5927cd5e expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.195687:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521947.195689:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521947.195691:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521947.195711:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1e22794d-c642-4031-a520-725ebfafbfe5:3306:1875400816954624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521947.195754:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521947.195882:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1e22794d-c642-4031-a520-725ebfafbfe5:3305:1875400816954496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521947.195909:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521947.195940:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799139712 00000100:00100000:0.0:1788521947.195946:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799139712 00010000:00010000:0.0:1788521947.195971:0:14410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996f829d5000/0x1b7b50db5927d005 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d6e expref: 12 pid: 14418 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521947.195989:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816954624 00000100:00100000:0.0:1788521947.195992:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816954624 00010000:00010000:0.0:1788521947.196003:0:14410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996fbc6d4c00/0x1b7b50db5927cd5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927cd57 expref: 18 pid: 14418 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521947.196013:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816954496 00000100:00100000:0.0:1788521947.196022:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816954496 00010000:00010000:0.0:1788521947.196035:0:14410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996f8392c000/0x1b7b50db5927cdab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927cda4 expref: 19 pid: 14420 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521947.196051:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:0.0:1788521947.196058:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f82aff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+12:2363:x1875400799139712:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521947.196070:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521947.196076:0:14410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996f829d5000/0x1b7b50db5927d005 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d6e expref: 12 pid: 14418 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.196093:0:14410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996f829d5000/0x1b7b50db5927d005 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d6e expref: 12 pid: 14418 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.196107:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f829d5000/0x1b7b50db5927d005 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d6e expref: 12 pid: 14418 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.197106:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521947.197435:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f82aff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+11:2363:x1875400799139712:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 1373us (2212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521947.197443:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:0.0:1788521947.197510:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788521947.197521:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e22794d-c642-4031-a520-725ebfafbfe5+19:3306:x1875400816954624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521947.197533:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521947.197540:0:14410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996fbc6d4c00/0x1b7b50db5927cd5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927cd57 expref: 19 pid: 14418 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.197549:0:14410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996fbc6d4c00/0x1b7b50db5927cd5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927cd57 expref: 19 pid: 14418 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.197578:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996fbc6d4c00/0x1b7b50db5927cd5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927cd57 expref: 19 pid: 14418 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.197588:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521947.197631:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e22794d-c642-4031-a520-725ebfafbfe5+18:3306:x1875400816954624:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (1877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521947.197638:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788521947.197651:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788521947.197657:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e22794d-c642-4031-a520-725ebfafbfe5+17:3305:x1875400816954496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521947.197665:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521947.197670:0:14410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996f8392c000/0x1b7b50db5927cdab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b7b50db5927cda4 expref: 17 pid: 14420 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.197684:0:14410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996f8392c000/0x1b7b50db5927cdab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b7b50db5927cda4 expref: 17 pid: 14420 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.197693:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996f8392c000/0x1b7b50db5927cdab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b7b50db5927cda4 expref: 17 pid: 14420 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.197703:0:14410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996fb490ae00/0x1b7b50db5927d067 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.197711:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fb490ae00/0x1b7b50db5927d067 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.197724:0:14410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996fb490ae00/0x1b7b50db5927d067 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.197731:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996fb490ae00/0x1b7b50db5927d067 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.197743:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996fb490ae00/0x1b7b50db5927d067 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.197750:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996fb490ae00/0x1b7b50db5927d067 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.197755:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490ae00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521947.197760:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996fb490ae00/0x1b7b50db5927d067 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.197769:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996fb490ae00/0x1b7b50db5927d067 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.197781:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996fb490ae00/0x1b7b50db5927d067 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.197805:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521947.198578:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e22794d-c642-4031-a520-725ebfafbfe5+16:3305:x1875400816954496:12345-0@lo:103:ldlm_bl.0 Request processed in 917us (2663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521947.198587:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788521947.198641:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1e22794d-c642-4031-a520-725ebfafbfe5:3305:1875400816954496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521947.198672:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1e22794d-c642-4031-a520-725ebfafbfe5:3306:1875400816954624:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521947.198690:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521947.199074:0:16537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996fb490ae00/0x1b7b50db5927d067 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521947.199085:0:16537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996fb490ae00/0x1b7b50db5927d067 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521947.199091:0:16537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996fb490ae00/0x1b7b50db5927d067 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521947.534531:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521948.502794:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521948.506948:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799139840 00000100:00100000:2.0:1788521948.506962:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799139840 00000100:00100000:2.0:1788521948.507025:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 105 00000100:00100000:2.0:1788521948.507036:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+11:13759:x1875400799139840:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521948.507056:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521948.507074:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996fb490bc00/0x1b7b50db5927d06e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00e01 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521948.507111:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fb490bc00/0x1b7b50db5927d06e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e01 expref: 12 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521948.507124:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996fb490bc00/0x1b7b50db5927d06e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e01 expref: 12 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521948.507132:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490bc00, rc 0) 00000100:00100000:2.0:1788521948.507216:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+12:13759:x1875400799139840:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 Request processed in 181us (4440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521948.507223:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 105 00000100:00100000:2.0:1788521948.520758:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521948.520900:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799139968 00000100:00100000:1.0:1788521948.520910:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799139968 00000100:00100000:1.0:1788521948.520961:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 106 00000100:00100000:1.0:1788521948.520970:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+12:13759:x1875400799139968:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521948.521275:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+12:13759:x1875400799139968:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 Request processed in 304us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521948.521283:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 106 00000100:00100000:1.0:1788521948.528960:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521948.529215:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799140096 00000100:00100000:3.0:1788521948.529225:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799140096 00000100:00100000:3.0:1788521948.529490:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 107 00000100:00100000:3.0:1788521948.529500:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+12:13759:x1875400799140096:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521948.529737:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+12:13759:x1875400799140096:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 Request processed in 237us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521948.529747:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 107 00000100:00100000:3.0:1788521948.549643:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521948.554739:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799140224 00000100:00100000:1.0:1788521948.554754:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799140224 00000100:00100000:1.0:1788521948.554847:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 108 00000100:00100000:1.0:1788521948.554856:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+12:13759:x1875400799140224:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521948.554872:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521948.554890:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996fbc6d5a00/0x1b7b50db5927d075 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00e08 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521948.554916:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fbc6d5a00/0x1b7b50db5927d075 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e08 expref: 13 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521948.554928:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996fbc6d5a00/0x1b7b50db5927d075 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e08 expref: 13 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521948.554937:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d5a00, rc 0) 00000100:00100000:1.0:1788521948.555007:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+13:13759:x1875400799140224:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 Request processed in 152us (5371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521948.555014:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 108 00000100:00100000:1.0:1788521948.558709:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00010000:00010000:0.0:1788521948.559553:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521948.559956:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799140352 00000100:00100000:3.0:1788521948.559970:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799140352 00000100:00100000:3.0:1788521948.560022:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 109 00000100:00100000:3.0:1788521948.560032:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+13:13759:x1875400799140352:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521948.561811:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+13:13759:x1875400799140352:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 Request processed in 1773us (3104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521948.561825:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 109 00000100:00100000:0.0:1788521948.570890:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521948.576949:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799140480 00000100:00100000:1.0:1788521948.576965:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799140480 00000100:00100000:0.0:1788521948.577090:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 110 00000100:00100000:0.0:1788521948.577114:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+13:13759:x1875400799140480:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521948.577358:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+13:13759:x1875400799140480:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 Request processed in 246us (6476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521948.577367:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 110 10000000:01000000:0.0:1788521948.687719:0:14423:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788521948.687727:0:14423:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff996fac9dc000 from 10 10000000:01000000:0.0:1788521948.687733:0:14423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788521948.687786:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb4001000/0x1b7b50db5927d07c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521948.687798:0:14423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996fb4001000/0x1b7b50db5927d07c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521948.687819:0:14423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996fb4001000/0x1b7b50db5927d07c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521948.687843:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f40e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816954752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788521948.688365:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521948.688411:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fbc3c4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788521948.690557:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816954752 00000100:00100000:2.0:1788521948.690569:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816954752 00000100:00100000:2.0:1788521948.690621:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788521948.690642:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+16:14423:x1875400816954752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521948.690660:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521948.690675:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996fb490b400/0x1b7b50db5927d083 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927d07c expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521948.690700:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fb490b400/0x1b7b50db5927d083 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927d07c expref: 17 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521948.690711:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996fb490b400/0x1b7b50db5927d083 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927d07c expref: 17 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521948.690719:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490b400, rc 0) 00000100:00100000:2.0:1788521948.690798:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+17:14423:x1875400816954752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (2433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521948.690869:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788521948.690976:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f40e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816954752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521948.690995:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996fb4001000/0x1b7b50db5927d07c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927d083 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521948.691005:0:14423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996fb4001000/0x1b7b50db5927d07c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927d083 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521948.691066:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82f9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816954880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521948.691097:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521948.691126:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f862a9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788521948.691139:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816954880 00000100:00100000:2.0:1788521948.691169:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816954880 00000100:00100000:2.0:1788521948.691191:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788521948.691206:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+17:14423:x1875400816954880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521948.691851:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+17:14423:x1875400816954880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 644us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521948.691860:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788521948.700336:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82f9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816954880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521948.700394:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816955008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521948.700534:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521948.700584:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816955008 00000100:00100000:1.0:1788521948.700590:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816955008 00000100:00100000:1.0:1788521948.700643:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788521948.700652:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+17:14423:x1875400816955008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521948.702549:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+17:14423:x1875400816955008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1890us (2007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521948.702569:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788521948.702639:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fad6d4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521948.702662:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816955008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788521948.712973:0:16602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788521948.713179:0:14423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788521948.713203:0:14423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788521948.713215:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb4001000/0x1b7b50db5927d07c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927d083 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521948.713227:0:14423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996fb4001000/0x1b7b50db5927d07c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927d083 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521948.713359:0:14423:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788521948.713362:0:14423:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff996f85d3d800 from 10 10000000:01000000:1.0:1788521948.713365:0:14423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788521948.713400:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4400/0x1b7b50db5927d08a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521948.713407:0:14423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4400/0x1b7b50db5927d08a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521948.713490:0:14423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4400/0x1b7b50db5927d08a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521948.713516:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816955136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788521948.713576:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521948.713616:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fad6d46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521948.713917:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816955136 00000100:00100000:0.0:1788521948.713925:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816955136 00000100:00100000:0.0:1788521948.713971:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788521948.713980:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+17:14423:x1875400816955136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521948.713992:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521948.714004:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996fb4001c00/0x1b7b50db5927d091 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927d08a expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521948.714025:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fb4001c00/0x1b7b50db5927d091 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927d08a expref: 18 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521948.714044:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996fb4001c00/0x1b7b50db5927d091 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927d08a expref: 18 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521948.714052:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4001c00, rc 0) 00000100:00100000:0.0:1788521948.714096:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+18:14423:x1875400816955136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521948.714103:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788521948.714216:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816955136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521948.714345:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4400/0x1b7b50db5927d08a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927d091 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521948.714357:0:14423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4400/0x1b7b50db5927d08a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927d091 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521948.714496:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816955264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521948.714529:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521948.714546:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fbc3c4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521948.714642:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816955264 00000100:00100000:1.0:1788521948.714646:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816955264 00000100:00100000:1.0:1788521948.714880:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788521948.714894:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+18:14423:x1875400816955264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521948.715121:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+18:14423:x1875400816955264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521948.715129:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788521948.716610:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816955264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521948.716664:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d35f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816955392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521948.716805:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521948.716846:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fad6d4900 going to sleep for 11 seconds 00000100:00100000:0.0:1788521948.716896:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816955392 00000100:00100000:0.0:1788521948.716905:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816955392 00000100:00100000:0.0:1788521948.716956:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788521948.716964:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+18:14423:x1875400816955392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521948.717165:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+18:14423:x1875400816955392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521948.717168:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d35f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816955392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521948.717174:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000040:00080000:3.0:1788521948.718359:0:16603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788521948.723873:0:14423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788521948.723907:0:14423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788521948.723932:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4400/0x1b7b50db5927d08a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927d091 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521948.723943:0:14423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996fbc6d4400/0x1b7b50db5927d08a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927d091 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521948.723955:0:14423:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788521948.723957:0:14423:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff996fb47cf000 from 10 10000000:01000000:0.0:1788521948.723961:0:14423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788521948.723995:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb4001200/0x1b7b50db5927d098 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521948.724002:0:14423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff996fb4001200/0x1b7b50db5927d098 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521948.724012:0:14423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff996fb4001200/0x1b7b50db5927d098 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521948.724035:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816955520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788521948.724097:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521948.724256:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fbc3c4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521948.724352:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816955520 00000100:00100000:1.0:1788521948.724359:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816955520 00000100:00100000:1.0:1788521948.724432:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788521948.724442:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+18:14423:x1875400816955520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521948.724454:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521948.724465:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996fbc6d4e00/0x1b7b50db5927d09f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b7b50db5927d098 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521948.724495:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996fbc6d4e00/0x1b7b50db5927d09f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b7b50db5927d098 expref: 19 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521948.724505:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996fbc6d4e00/0x1b7b50db5927d09f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b7b50db5927d098 expref: 19 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521948.724512:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d4e00, rc 0) 00000100:00100000:1.0:1788521948.724549:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+19:14423:x1875400816955520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521948.724565:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788521948.724681:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816955520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521948.724695:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff996fb4001200/0x1b7b50db5927d098 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927d09f expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521948.724773:0:14423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff996fb4001200/0x1b7b50db5927d098 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b7b50db5927d09f expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521948.724839:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816955648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521948.724872:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521948.724890:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fbc3c4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521948.724904:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816955648 00000100:00100000:0.0:1788521948.724907:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816955648 00000100:00100000:0.0:1788521948.724929:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788521948.724935:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+19:14423:x1875400816955648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521948.725502:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+19:14423:x1875400816955648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 564us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521948.725511:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788521948.725631:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816955648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521948.725666:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d35f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816955776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521948.725791:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521948.725849:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb4584900 going to sleep for 11 seconds 00000100:00100000:0.0:1788521948.725883:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816955776 00000100:00100000:0.0:1788521948.725888:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816955776 00000100:00100000:0.0:1788521948.725957:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788521948.725965:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+19:14423:x1875400816955776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521948.726110:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e22794d-c642-4031-a520-725ebfafbfe5+19:14423:x1875400816955776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521948.726117:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788521948.726328:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d35f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1e22794d-c642-4031-a520-725ebfafbfe5:14423:1875400816955776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788521948.727646:0:16605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788521948.727895:0:14423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788521948.727916:0:14423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788521948.727926:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff996fb4001200/0x1b7b50db5927d098 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927d09f expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521948.727937:0:14423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff996fb4001200/0x1b7b50db5927d098 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b7b50db5927d09f expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521949.584418:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521950.542411:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f85d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816955904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521950.542479:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521950.542583:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82a61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875400816956416:0@lo:400:kworker.0 00000100:00100000:3.0:1788521950.542602:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816956160:0@lo:400:kworker.0 00000100:00100000:2.0:1788521950.542615:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521950.542637:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788521950.542643:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82a60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875400816956288:0@lo:400:kworker.0 00000100:00100000:2.0:1788521950.542672:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521950.542681:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521950.542706:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816956416 00000100:00100000:3.0:1788521950.542712:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788521950.542713:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816956416 00000100:00100000:3.0:1788521950.542720:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82a60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1e22794d-c642-4031-a520-725ebfafbfe5:3305:1875400816956032:0@lo:400:kworker.0 00000100:00100000:3.0:1788521950.542754:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521950.542777:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816956288 00000100:00100000:2.0:1788521950.542782:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816956288 00000100:00100000:2.0:1788521950.542818:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788521950.542827:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82f9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875400816956416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521950.542850:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82a61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875400816956544:0@lo:400:kworker.0 00000100:00100000:2.0:1788521950.542896:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82f9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875400816956416:12345-0@lo:400:kworker.0 Request processed in 70us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521950.542905:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788521950.542923:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788521950.542930:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82f9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875400816956288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521950.542931:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816955904 00000100:00100000:1.0:1788521950.542937:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816955904 00000100:00100000:1.0:1788521950.542982:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788521950.542989:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82f9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816955904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521950.543027:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521950.545032:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788521950.545054:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816956672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521950.546163:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521950.548152:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816956160 00000100:00100000:3.0:1788521950.548166:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816956160 00000100:00100000:3.0:1788521950.548235:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788521950.548245:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816956160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521950.548326:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816956160:12345-0@lo:400:kworker.0 Request processed in 82us (5645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521950.548348:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788521950.548392:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816956160:0@lo:400:kworker.0 00000100:00100000:3.0:1788521950.549254:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816956544 00000100:00100000:3.0:1788521950.549261:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816956544 00000100:00100000:3.0:1788521950.549292:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788521950.549299:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875400816956544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521950.549348:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875400816956544:12345-0@lo:400:kworker.0 Request processed in 50us (3189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521950.549354:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1788521950.549370:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788521950.549374:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788521950.549377:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521950.549400:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82a61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875400816956544:0@lo:400:kworker.0 00000100:00100000:3.0:1788521950.549445:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82a61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875400816956416:0@lo:400:kworker.0 00000100:00100000:3.0:1788521950.549482:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816956032 00000100:00100000:3.0:1788521950.549486:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816956032 00000100:00100000:3.0:1788521950.549509:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788521950.549514:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+19:3305:x1875400816956032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521950.549543:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e22794d-c642-4031-a520-725ebfafbfe5+19:3305:x1875400816956032:12345-0@lo:400:kworker.0 Request processed in 29us (6790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521950.549548:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788521950.549575:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82a60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1e22794d-c642-4031-a520-725ebfafbfe5:3305:1875400816956032:0@lo:400:kworker.0 00000100:00100000:2.0:1788521950.550791:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82f9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875400816956288:12345-0@lo:400:kworker.0 Request processed in 7856us (8113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521950.550814:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788521950.551119:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82a60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875400816956288:0@lo:400:kworker.0 00000100:00100000:1.0:1788521950.556455:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82f9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816955904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 13459us (13968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521950.556649:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788521950.556910:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f85d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816955904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521950.557313:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521950.560166:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816956672 00000100:00100000:3.0:1788521950.560181:0:15111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816956672 00000100:00100000:3.0:1788521950.560252:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788521950.560263:0:15111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816956672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788521950.560305:0:15111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521950.560381:0:15111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875400816956672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (3068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521950.560388:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788521950.560568:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875400816956672:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788521950.606526:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521950.782885:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521950.783333:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799140608 00000100:00100000:3.0:1788521950.783343:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799140608 00000100:00100000:3.0:1788521950.784725:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:3.0:1788521950.784743:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+6:14414:x1875400799140608:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521950.784765:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521950.784795:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4400/0x1b7b50db5927d0a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00e0f expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521950.784866:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d0ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521950.784983:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d0ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521950.784998:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d0ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521950.785015:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d0b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521950.785022:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d0b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521950.785043:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d0b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521950.787086:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5800/0x1b7b50db5927d0bb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521950.787105:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5800/0x1b7b50db5927d0bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521950.787118:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5800/0x1b7b50db5927d0bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521950.787160:0:14426:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788521950.787164:0:14426:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788521950.787204:0:14426:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5800/0x1b7b50db5927d0bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521950.787216:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d0ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788521950.788888:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788521950.789357:0:14426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d0ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521950.789366:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d0ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521950.789371:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d5400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521950.790310:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d0ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521950.790325:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d0ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521950.790359:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996f83d40d00) 00010000:00010000:3.0:1788521950.790363:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521950.790368:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d0ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521950.790942:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d0ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521950.790966:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d0b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521950.790972:0:14426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d0b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521950.790978:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d0b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521950.790983:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d4200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521950.790986:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d0b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521950.790992:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d0b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521950.791001:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff996f83d40000) 00010000:00010000:3.0:1788521950.791003:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521950.791006:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d0b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521950.791012:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d0b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521950.791072:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4400/0x1b7b50db5927d0a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e0f expref: 8 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521950.792074:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5800/0x1b7b50db5927d0bb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e0f expref: 7 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521950.792095:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff996f83d40300) 00010000:00010000:3.0:1788521950.792098:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788521950.792101:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f829d5800, rc 0) 00000100:00100000:3.0:1788521950.792187:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+7:14414:x1875400799140608:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 7449us (9307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521950.792196:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:1.0:1788521950.805164:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521950.807087:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799140864 00000100:00100000:3.0:1788521950.807101:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799140864 00000100:00100000:0.0:1788521950.808100:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:0.0:1788521950.808111:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+7:14414:x1875400799140864:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788521950.808130:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521950.808438:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927d0c2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00e16 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.809587:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927d0c9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.810119:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927d0c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.810136:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927d0c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.810422:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927d0d0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.810431:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927d0d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.810438:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927d0d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.812260:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000e00/0x1b7b50db5927d0d7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.812415:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000e00/0x1b7b50db5927d0d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.812427:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000e00/0x1b7b50db5927d0d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521950.812439:0:14427:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788521950.812966:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927d0c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.812986:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927d0c9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.812994:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927d0c9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.812999:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521950.813004:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927d0c9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.813011:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927d0c9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.813022:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff996f83d40300) 00010000:00010000:0.0:1788521950.813024:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521950.813029:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927d0c9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.813034:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927d0c9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.813047:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927d0d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.813053:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927d0d0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.813059:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927d0d0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.813064:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521950.813073:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927d0d0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.813080:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927d0d0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.813089:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff996f83d6d400) 00010000:00010000:0.0:1788521950.813092:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521950.813095:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927d0d0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.813101:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927d0d0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.814266:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927d0c2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e16 expref: 10 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.814517:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000e00/0x1b7b50db5927d0d7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e16 expref: 9 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.814527:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996f83d6de00) 00010000:00010000:0.0:1788521950.814529:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521950.814532:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4000e00, rc 0) 00000100:00100000:0.0:1788521950.814604:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+9:14414:x1875400799140864:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 6494us (10046us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788521950.814613:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:0.0:1788521950.823316:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521950.823747:0:16498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799140992 00000100:00100000:3.0:1788521950.823761:0:16498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799140992 00000100:00100000:3.0:1788521950.823847:0:16498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:3.0:1788521950.823860:0:16498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+9:14414:x1875400799140992:12345-192.168.206.48@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788521950.824019:0:16498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+9:14414:x1875400799140992:12345-192.168.206.48@tcp:59:lhsmtool_posix.0 Request processed in 160us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521950.824028:0:16498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:1.0:1788521950.851475:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521950.851809:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799141120 00000100:00100000:2.0:1788521950.851825:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799141120 00000100:00100000:2.0:1788521950.851900:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:2.0:1788521950.851911:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+9:14420:x1875400799141120:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521950.851931:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521950.851957:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927d0e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00e1d expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.852017:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927d0ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.852032:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927d0ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.852044:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927d0ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.852061:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d0f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.852068:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.852075:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.853386:0:14425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927d0ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.853399:0:14425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927d0ec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.853418:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927d0ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.853424:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb490b600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521950.853429:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927d0ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.853436:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927d0ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.853450:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996f83d40d00) 00010000:00010000:2.0:1788521950.853453:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521950.853458:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927d0ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.853465:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490b600/0x1b7b50db5927d0ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.853480:0:14425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.853487:0:14425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d0f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.853493:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d0f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.853498:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80031800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521950.853501:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d0f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.853517:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d0f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.853525:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff996fb19ef100) 00010000:00010000:2.0:1788521950.853528:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521950.853531:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d0f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.853536:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d0f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.853576:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927d0e5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e1d expref: 10 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.853587:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996f83d40d00) 00010000:00010000:2.0:1788521950.853589:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521950.853593:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb490ae00/0x1b7b50db5927d0e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e1d expref: 10 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.853603:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb490ae00, rc 0) 00000100:00100000:2.0:1788521950.853667:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+9:14420:x1875400799141120:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 1757us (2209us total) trans 0 rc 301/301 00000100:00100000:2.0:1788521950.853677:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:1.0:1788521950.859265:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521950.859418:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799141248 00000100:00100000:2.0:1788521950.859433:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799141248 00000100:00100000:2.0:1788521950.859498:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:2.0:1788521950.859511:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f85d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+9:14420:x1875400799141248:12345-192.168.206.48@tcp:700:lfs.0 00000100:00100000:2.0:1788521950.860009:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f85d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+9:14420:x1875400799141248:12345-192.168.206.48@tcp:700:lfs.0 Request processed in 498us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521950.860019:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:0.0:1788521950.867310:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521950.867535:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799141504 00000100:00100000:2.0:1788521950.867548:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799141504 00000100:00100000:2.0:1788521950.867630:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:2.0:1788521950.867642:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+9:14420:x1875400799141504:12345-192.168.206.48@tcp:36:lfs.0 00010000:00010000:2.0:1788521950.867713:0:14426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521950.867750:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5600/0x1b7b50db5927d028 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00d98 expref: 9 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.867785:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996f83d40d00) 00010000:00010000:2.0:1788521950.867791:0:14426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521950.868031:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d0fa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.868048:0:14426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927d060 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00dfa expref: 5 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.868057:0:14426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d0fa lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.868096:0:14426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927d060 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00dfa expref: 5 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.868120:0:14426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927d060 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00dfa expref: 5 pid: 14426 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521950.868226:0:14426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82f9d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14426:1875400816956800:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788521950.868332:0:14426:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f90f00780 going to sleep for 11 seconds 00000100:00100000:3.0:1788521950.875951:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521950.876085:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799141632 00000100:00100000:0.0:1788521950.876114:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799141632 00010000:00010000:0.0:1788521950.876226:0:14410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927d060 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00dfa expref: 6 pid: 14426 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521950.876271:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:0.0:1788521950.876283:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+6:2363:x1875400799141632:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521950.876302:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521950.876310:0:14410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927d060 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00dfa expref: 6 pid: 14426 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.876335:0:14410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927d060 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00dfa expref: 6 pid: 14426 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.876363:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996f83d40d00) 00010000:00010000:0.0:1788521950.876368:0:14410:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d0fa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.876380:0:14410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d0fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.876389:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d0fa lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.876412:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521950.876488:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+6:2363:x1875400799141632:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 206us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521950.876495:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00080000:3.0:1788521950.876753:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788521950.877523:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5c00/0x1b7b50db5927d060 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00dfa expref: 5 pid: 14426 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521950.877553:0:14426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82f9d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14426:1875400816956800:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788521950.877582:0:14426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d0fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.877592:0:14426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d0fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.877599:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d0fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.877640:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030200/0x1b7b50db5927d101 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.877652:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030200/0x1b7b50db5927d101 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.877662:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030200/0x1b7b50db5927d101 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521950.879600:0:14426:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788521950.879623:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d0fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.879634:0:14426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d0fa lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.879650:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d0fa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.879657:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80031800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521950.879661:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d0fa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.879671:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d0fa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.879690:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996f83d40d00) 00010000:00010000:2.0:1788521950.879694:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521950.879699:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d0fa lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.879707:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d0fa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788521950.879733:0:14426:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6cc9bb7 reply state 000000003414bd5e transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030200/0x1b7b50db5927d101 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521950.879744:0:14426:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788521950.879882:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+10:14420:x1875400799141504:12345-192.168.206.48@tcp:36:lfs.0 Request processed in 12236us (12579us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788521950.879892:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 19 00010000:00010000:0.0:1788521950.886466:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030200/0x1b7b50db5927d101 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.886508:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030200/0x1b7b50db5927d101 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.886516:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030200/0x1b7b50db5927d101 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.886522:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80030200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521950.886527:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030200/0x1b7b50db5927d101 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.886537:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030200/0x1b7b50db5927d101 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.886558:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff996fb19ef100) 00010000:00010000:0.0:1788521950.886561:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521950.886567:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030200/0x1b7b50db5927d101 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521950.886574:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030200/0x1b7b50db5927d101 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521950.991683:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521950.992454:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799141760 00000100:00100000:2.0:1788521950.992472:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799141760 00000100:00100000:2.0:1788521950.992559:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:2.0:1788521950.992573:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+9:14428:x1875400799141760:12345-192.168.206.48@tcp:101:lctl.0 00010000:00010000:2.0:1788521950.992626:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521950.992657:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d108 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00e24 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.992747:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030a00/0x1b7b50db5927d10f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.992779:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030a00/0x1b7b50db5927d10f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.992803:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030a00/0x1b7b50db5927d10f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521950.992848:0:14427:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788521950.992853:0:14427:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521950.992902:0:14427:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030a00/0x1b7b50db5927d10f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.992931:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d108 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e24 expref: 11 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.992954:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030a00/0x1b7b50db5927d10f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e24 expref: 10 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521950.992964:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19ef600) 00010000:00010000:2.0:1788521950.992967:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788521950.992971:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f80030a00, rc 0) 00000100:00100000:2.0:1788521950.993055:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+10:14428:x1875400799141760:12345-192.168.206.48@tcp:101:lctl.0 Request processed in 485us (1398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521950.993073:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 20 00000040:00080000:0.0:1788521950.995322:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788521951.018331:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521951.019085:0:16498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799141888 00000100:00100000:0.0:1788521951.019100:0:16498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799141888 00000100:00100000:0.0:1788521951.019226:0:16498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:0.0:1788521951.019240:0:16498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+5:14429:x1875400799141888:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1788521951.019271:0:16498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521951.019715:0:16498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927d116 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00e2b expref: -99 pid: 16498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.019838:0:16498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927d11d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.019856:0:16498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927d11d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.019874:0:16498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927d11d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521951.019919:0:16498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788521951.019923:0:16498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788521951.019951:0:16498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927d11d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.019986:0:16498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927d116 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e2b expref: 7 pid: 16498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.020009:0:16498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000400/0x1b7b50db5927d11d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e2b expref: 6 pid: 16498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.020022:0:16498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19ef600) 00010000:00010000:0.0:1788521951.020025:0:16498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788521951.020030:0:16498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4000400, rc 0) 00000100:00100000:0.0:1788521951.020128:0:16498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+6:14429:x1875400799141888:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 890us (1808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521951.020138:0:16498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:1.0:1788521951.028126:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521951.029110:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799142016 00000100:00100000:2.0:1788521951.029134:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799142016 00000100:00100000:2.0:1788521951.029424:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:2.0:1788521951.029445:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+6:14429:x1875400799142016:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521951.029570:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521951.029612:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031c00/0x1b7b50db5927d124 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00e32 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.030346:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030000/0x1b7b50db5927d12b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.030378:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030000/0x1b7b50db5927d12b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.030399:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030000/0x1b7b50db5927d12b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.030428:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030c00/0x1b7b50db5927d132 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.030441:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030c00/0x1b7b50db5927d132 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.030450:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030c00/0x1b7b50db5927d132 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.031305:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031600/0x1b7b50db5927d139 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.031344:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031600/0x1b7b50db5927d139 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.031357:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031600/0x1b7b50db5927d139 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521951.031402:0:14427:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788521951.031406:0:14427:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521951.031493:0:14427:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031600/0x1b7b50db5927d139 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.031510:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030000/0x1b7b50db5927d12b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.031516:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030000/0x1b7b50db5927d12b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.031524:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030000/0x1b7b50db5927d12b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.031529:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80030000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521951.031533:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030000/0x1b7b50db5927d12b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.031539:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030000/0x1b7b50db5927d12b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.031551:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19ef600) 00010000:00010000:2.0:1788521951.031553:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521951.031557:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030000/0x1b7b50db5927d12b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.031573:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030000/0x1b7b50db5927d12b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.031590:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030c00/0x1b7b50db5927d132 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.031596:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030c00/0x1b7b50db5927d132 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.031602:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030c00/0x1b7b50db5927d132 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.031607:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80030c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521951.031610:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030c00/0x1b7b50db5927d132 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.031616:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030c00/0x1b7b50db5927d132 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.031624:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff996fb19ef200) 00010000:00010000:2.0:1788521951.031626:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521951.031630:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030c00/0x1b7b50db5927d132 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.031635:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030c00/0x1b7b50db5927d132 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.032137:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031c00/0x1b7b50db5927d124 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e32 expref: 8 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.032217:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031600/0x1b7b50db5927d139 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e32 expref: 7 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.032224:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff996fb19efe00) 00010000:00010000:2.0:1788521951.032226:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788521951.032229:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f80031600, rc 0) 00000100:00100000:2.0:1788521951.032304:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+7:14429:x1875400799142016:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 2866us (4191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521951.032313:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:2.0:1788521951.035442:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521951.035582:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799142272 00000100:00100000:3.0:1788521951.035593:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799142272 00000100:00100000:3.0:1788521951.035678:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:3.0:1788521951.035689:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82f9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+7:14429:x1875400799142272:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521951.035708:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521951.035740:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4400/0x1b7b50db5927d140 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00e39 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521951.035844:0:14426:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788521951.035971:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4400/0x1b7b50db5927d140 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e39 expref: 9 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.035986:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19ef600) 00010000:00010000:3.0:1788521951.035989:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788521951.035995:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4400/0x1b7b50db5927d140 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e39 expref: 9 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.036008:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f829d4400, rc 0) 00000100:00100000:3.0:1788521951.036071:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82f9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+8:14429:x1875400799142272:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 383us (650us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788521951.036078:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:3.0:1788521951.044756:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521951.044873:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799142528 00000100:00100000:2.0:1788521951.044884:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799142528 00000100:00100000:2.0:1788521951.044945:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 24 00000100:00100000:2.0:1788521951.044955:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+8:14429:x1875400799142528:12345-192.168.206.48@tcp:36:lfs.0 00010000:00010000:2.0:1788521951.045013:0:14425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521951.045039:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031600/0x1b7b50db5927d139 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e32 expref: 8 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.045058:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff996fb19efe00) 00010000:00010000:2.0:1788521951.045069:0:14425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521951.045093:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031c00/0x1b7b50db5927d14e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.045106:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031c00/0x1b7b50db5927d14e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.045115:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031c00/0x1b7b50db5927d14e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788521951.045393:0:14425:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003626d17c reply state 000000001b73c45a transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031c00/0x1b7b50db5927d14e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521951.045403:0:14425:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788521951.045410:0:14425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788521951.045494:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+9:14429:x1875400799142528:12345-192.168.206.48@tcp:36:lfs.0 Request processed in 540us (747us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788521951.045501:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 24 00000100:00100000:1.0:1788521951.048299:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00010000:00010000:0.0:1788521951.048849:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031c00/0x1b7b50db5927d14e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.048892:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031c00/0x1b7b50db5927d14e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.048902:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031c00/0x1b7b50db5927d14e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.048908:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80031c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521951.048914:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031c00/0x1b7b50db5927d14e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.048923:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031c00/0x1b7b50db5927d14e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.048944:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff996fb19ef200) 00010000:00010000:0.0:1788521951.048947:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788521951.048954:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031c00/0x1b7b50db5927d14e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.048960:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031c00/0x1b7b50db5927d14e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521951.049067:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799142784 00000100:00100000:3.0:1788521951.049077:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799142784 00000100:00100000:3.0:1788521951.049285:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:3.0:1788521951.049297:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+8:14429:x1875400799142784:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:3.0:1788521951.049541:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+9:14429:x1875400799142784:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 245us (1248us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788521951.049549:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:1.0:1788521951.055548:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521951.056236:0:16498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799143040 00000100:00100000:0.0:1788521951.056246:0:16498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799143040 00000100:00100000:1.0:1788521951.056662:0:16498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 25 00000100:00100000:1.0:1788521951.056674:0:16498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+9:14429:x1875400799143040:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1788521951.056696:0:16498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521951.056715:0:16498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927d155 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00e40 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521951.057324:0:16498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927d15c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521951.057340:0:16498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927d15c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521951.057351:0:16498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927d15c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521951.057365:0:16498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4c00/0x1b7b50db5927d163 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521951.057372:0:16498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4c00/0x1b7b50db5927d163 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521951.057378:0:16498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4c00/0x1b7b50db5927d163 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521951.058267:0:16498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788521951.058657:0:16498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927d15c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521951.058678:0:16498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927d15c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521951.058686:0:16498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927d15c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521951.058691:0:16498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521951.058696:0:16498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927d15c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521951.058704:0:16498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927d15c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521951.058717:0:16498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19ef600) 00010000:00010000:1.0:1788521951.058720:0:16498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521951.058805:0:16498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927d15c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521951.058812:0:16498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5200/0x1b7b50db5927d15c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521951.058827:0:16498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4c00/0x1b7b50db5927d163 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521951.058834:0:16498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4c00/0x1b7b50db5927d163 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521951.058840:0:16498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4c00/0x1b7b50db5927d163 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521951.058845:0:16498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d4c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1788521951.058853:0:16498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4c00/0x1b7b50db5927d163 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521951.058860:0:16498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4c00/0x1b7b50db5927d163 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521951.058868:0:16498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff996fa0d5c500) 00010000:00010000:1.0:1788521951.058871:0:16498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521951.058873:0:16498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4c00/0x1b7b50db5927d163 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521951.058879:0:16498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4c00/0x1b7b50db5927d163 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521951.058925:0:16498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927d155 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e40 expref: 11 pid: 16498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521951.058935:0:16498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19ef600) 00010000:00010000:1.0:1788521951.058937:0:16498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788521951.058941:0:16498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927d155 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e40 expref: 11 pid: 16498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521951.058950:0:16498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d5000, rc 0) 00000100:00100000:1.0:1788521951.059076:0:16498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+10:14429:x1875400799143040:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 2403us (3534us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1788521951.059084:0:16498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 25 00000100:00100000:2.0:1788521951.067112:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521951.067384:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799143168 00000100:00100000:3.0:1788521951.067394:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799143168 00000100:00100000:3.0:1788521951.067860:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 26 00000100:00100000:3.0:1788521951.067874:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+10:14429:x1875400799143168:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521951.067896:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521951.067919:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4400/0x1b7b50db5927d171 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00e47 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.068002:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d178 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.068016:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d178 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.068027:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d178 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521951.068050:0:14425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788521951.068053:0:14425:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788521951.068070:0:14425:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d178 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.068094:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4400/0x1b7b50db5927d171 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e47 expref: 12 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.068112:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d178 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e47 expref: 11 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.068121:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff996f83d40000) 00010000:00010000:3.0:1788521951.068124:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788521951.068187:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f829d4200, rc 0) 00000100:00100000:3.0:1788521951.068243:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+11:14429:x1875400799143168:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 372us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521951.068250:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 26 00000100:00100000:2.0:1788521951.079876:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521951.079997:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799143296 00000100:00100000:3.0:1788521951.080007:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799143296 00000100:00100000:3.0:1788521951.080060:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:3.0:1788521951.080069:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82f9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+11:14429:x1875400799143296:12345-192.168.206.48@tcp:37:lfs.0 00000100:00100000:2.0:1788521951.084992:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82f9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+11:14429:x1875400799143296:12345-192.168.206.48@tcp:37:lfs.0 Request processed in 4914us (5115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521951.085009:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:3.0:1788521951.089869:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521951.089954:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799143552 00000100:00100000:0.0:1788521951.089965:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799143552 00000100:00100000:0.0:1788521951.090064:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:0.0:1788521951.090074:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7db3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+11:14429:x1875400799143552:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:0.0:1788521951.090321:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7db3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+12:14429:x1875400799143552:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 248us (461us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788521951.090344:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:2.0:1788521951.150116:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521951.152813:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799143680 00000100:00100000:3.0:1788521951.152838:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799143680 00000100:00100000:3.0:1788521951.152948:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:3.0:1788521951.152962:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82f9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+10:14435:x1875400799143680:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:3.0:1788521951.152989:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521951.153017:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4400/0x1b7b50db5927d17f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00e4e expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.153100:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d186 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.153119:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d186 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.153133:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d186 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.153193:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4e00/0x1b7b50db5927d18d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.153201:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4e00/0x1b7b50db5927d18d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.153231:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4e00/0x1b7b50db5927d18d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.153371:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5600/0x1b7b50db5927d194 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.153380:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5600/0x1b7b50db5927d194 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.153387:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5600/0x1b7b50db5927d194 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521951.153423:0:14426:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788521951.153428:0:14426:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788521951.153476:0:14426:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5600/0x1b7b50db5927d194 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.153492:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d186 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.153499:0:14426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d186 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.153508:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d186 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.153514:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d5400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521951.153518:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d186 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.153526:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d186 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.153548:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19ef600) 00010000:00010000:3.0:1788521951.153551:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521951.153557:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d186 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.153564:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d186 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.153580:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4e00/0x1b7b50db5927d18d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.153586:0:14426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4e00/0x1b7b50db5927d18d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.153592:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4e00/0x1b7b50db5927d18d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.153596:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d4e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521951.153599:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4e00/0x1b7b50db5927d18d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.153605:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4e00/0x1b7b50db5927d18d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.153614:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff996f83d40b00) 00010000:00010000:3.0:1788521951.153616:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521951.153619:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4e00/0x1b7b50db5927d18d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.153624:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4e00/0x1b7b50db5927d18d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.153677:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4400/0x1b7b50db5927d17f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e4e expref: 12 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.153692:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5600/0x1b7b50db5927d194 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e4e expref: 11 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.153701:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff996f83d40000) 00010000:00010000:3.0:1788521951.153703:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788521951.153706:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f829d5600, rc 0) 00000100:00100000:3.0:1788521951.153808:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82f9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+11:14435:x1875400799143680:12345-192.168.206.48@tcp:101:bash.0 Request processed in 849us (3713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521951.153815:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:1.0:1788521951.164311:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521951.164470:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799143936 00000100:00100000:0.0:1788521951.164487:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799143936 00000100:00100000:0.0:1788521951.164567:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 28 00000100:00100000:0.0:1788521951.164578:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+11:14435:x1875400799143936:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:0.0:1788521951.164599:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521951.164622:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927d19b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00e55 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.164735:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927d1a2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.164750:0:14427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d178 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e47 expref: 11 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.164760:0:14427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927d1a2 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.164807:0:14427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d178 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e47 expref: 11 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.164829:0:14427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d178 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e47 expref: 11 pid: 14425 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521951.164844:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f43100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14427:1875400816956928:192.168.206.48@tcp:104: 00000100:00100000:0.0:1788521951.164942:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86583240 going to sleep for 11 seconds 00000100:00100000:0.0:1788521951.169065:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f43100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14427:1875400816956928:192.168.206.48@tcp:104: 00010000:00010000:0.0:1788521951.169230:0:14427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927d1a2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521951.171658:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521951.171754:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799144064 00000100:00100000:3.0:1788521951.171777:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799144064 00010000:00010000:3.0:1788521951.171823:0:14412:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d178 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e47 expref: 12 pid: 14425 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521951.171932:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:0.0:1788521951.171945:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+12:2364:x1875400799144064:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521951.171958:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521951.171966:0:14410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d178 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e47 expref: 12 pid: 14425 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.171989:0:14410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d178 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e47 expref: 12 pid: 14425 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.172012:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d178 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e47 expref: 12 pid: 14425 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.172031:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff996f83d40000) 00010000:00010000:0.0:1788521951.172037:0:14410:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927d1a2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.172047:0:14410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927d1a2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.172055:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927d1a2 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.172398:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521951.172460:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+11:2364:x1875400799144064:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 518us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521951.172468:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 10 00010000:00010000:2.0:1788521951.172658:0:14427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927d1a2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.172668:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927d1a2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.172701:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927d1a9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.172712:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927d1a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.172721:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927d1a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.173835:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927d1b0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.173847:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927d1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.173857:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927d1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521951.173867:0:14427:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788521951.173893:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927d1a2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.173900:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927d1a2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.173907:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927d1a2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.173913:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521951.173918:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927d1a2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.173926:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927d1a2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.173937:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff996f83d40000) 00010000:00010000:2.0:1788521951.173939:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521951.173943:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927d1a2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.173961:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000c00/0x1b7b50db5927d1a2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788521951.173973:0:14427:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009235d1dd reply state 000000000b8fd2ce transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927d1a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521951.173982:0:14427:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788521951.174014:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927d19b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e55 expref: 14 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.174027:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927d1b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e55 expref: 13 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.174034:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996fb19eff00) 00010000:00010000:2.0:1788521951.174037:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788521951.174039:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f80031a00, rc 0) 00000100:00100000:2.0:1788521951.174783:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+14:14435:x1875400799143936:12345-192.168.206.48@tcp:101:bash.0 Request processed in 10202us (10482us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788521951.174793:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 28 00010000:00010000:3.0:1788521951.183025:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927d1a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.183041:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927d1a9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.183049:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927d1a9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.183055:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80030400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521951.183060:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927d1a9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.183084:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927d1a9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.183100:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff996fb19efe00) 00010000:00010000:3.0:1788521951.183103:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521951.183107:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927d1a9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.183114:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927d1a9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521951.201642:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521951.201893:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799144192 00000100:00100000:2.0:1788521951.201904:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799144192 00000100:00100000:2.0:1788521951.201964:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 29 00000100:00100000:2.0:1788521951.201974:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+13:14435:x1875400799144192:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:2.0:1788521951.201998:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521951.202016:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927d1be lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00e5c expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.202091:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927d1c5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.202105:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927d1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.202117:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927d1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521951.202189:0:14426:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788521951.202193:0:14426:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521951.202212:0:14426:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927d1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.202222:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927d1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.202244:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927d1be lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e5c expref: 15 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.202262:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927d1c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e5c expref: 14 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.202270:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996fb19eff00) 00010000:00010000:2.0:1788521951.202273:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521951.202277:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f80030400, rc 0) 00000100:00100000:2.0:1788521951.202342:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+14:14435:x1875400799144192:12345-192.168.206.48@tcp:101:bash.0 Request processed in 368us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521951.202349:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 29 00000100:00100000:1.0:1788521951.209759:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521951.209859:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799144448 00000100:00100000:2.0:1788521951.209868:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799144448 00000100:00100000:2.0:1788521951.209921:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:2.0:1788521951.209931:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+14:14435:x1875400799144448:12345-192.168.206.48@tcp:35:bash.0 00000100:00100000:2.0:1788521951.210289:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+15:14435:x1875400799144448:12345-192.168.206.48@tcp:35:bash.0 Request processed in 359us (538us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788521951.210297:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:3.0:1788521951.281372:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521951.281538:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799144704 00000100:00100000:2.0:1788521951.281547:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799144704 00000100:00100000:2.0:1788521951.281608:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 30 00000100:00100000:2.0:1788521951.281620:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+15:14445:x1875400799144704:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521951.281644:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521951.281667:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927d1cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00e63 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521951.281755:0:14425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788521951.281892:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927d1cc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e63 expref: 17 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.281908:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996fb19ef600) 00010000:00010000:2.0:1788521951.281911:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521951.281917:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927d1cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e63 expref: 17 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.281933:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f80030600, rc 0) 00000100:00100000:2.0:1788521951.281998:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+16:14445:x1875400799144704:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 380us (634us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788521951.282022:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 30 00000100:00100000:3.0:1788521951.284992:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521951.285186:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799144960 00000100:00100000:2.0:1788521951.285195:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799144960 00000100:00100000:2.0:1788521951.285249:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:2.0:1788521951.285260:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+16:14445:x1875400799144960:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:2.0:1788521951.285487:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+17:14445:x1875400799144960:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 228us (502us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788521951.285495:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:1.0:1788521951.314654:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521951.314868:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799145216 00000100:00100000:2.0:1788521951.314882:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799145216 00000100:00100000:2.0:1788521951.314988:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 31 00000100:00100000:2.0:1788521951.315001:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+17:14448:x1875400799145216:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521951.315031:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521951.315058:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927d1da lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00e6a expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.315244:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927d1e1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.315264:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927d1e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.315280:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927d1e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521951.315294:0:14426:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788521951.315472:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927d1da lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e6a expref: 20 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.315508:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927d1e1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e6a expref: 19 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.315518:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996fb19eff00) 00010000:00010000:2.0:1788521951.315522:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521951.315527:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f80031400, rc 0) 00000100:00100000:2.0:1788521951.315673:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+19:14448:x1875400799145216:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 674us (1036us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788521951.315682:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 31 00000100:00100000:3.0:1788521951.318845:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521951.318981:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799145344 00000100:00100000:2.0:1788521951.318995:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799145344 00000100:00100000:2.0:1788521951.319068:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 32 00000100:00100000:2.0:1788521951.319080:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+19:14448:x1875400799145344:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:2.0:1788521951.319196:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030000/0x1b7b50db5927d1ef lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.319219:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030000/0x1b7b50db5927d1ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.319234:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030000/0x1b7b50db5927d1ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.319266:0:14425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030000/0x1b7b50db5927d1ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.319275:0:14425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030000/0x1b7b50db5927d1ef lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.319306:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030000/0x1b7b50db5927d1ef lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.319313:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80030000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521951.319318:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030000/0x1b7b50db5927d1ef lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.319327:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030000/0x1b7b50db5927d1ef lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.319353:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996fb19eff00) 00010000:00010000:2.0:1788521951.319357:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521951.319363:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030000/0x1b7b50db5927d1ef lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.319370:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030000/0x1b7b50db5927d1ef lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521951.319468:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+19:14448:x1875400799145344:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 389us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521951.319476:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 32 00000100:00100000:0.0:1788521951.321618:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521951.321695:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799145728 00000100:00100000:2.0:1788521951.321707:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799145728 00000100:00100000:2.0:1788521951.321779:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:2.0:1788521951.321791:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+19:14448:x1875400799145728:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:2.0:1788521951.322107:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+20:14448:x1875400799145728:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 317us (501us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788521951.322116:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:1.0:1788521951.325612:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521951.325728:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799145472 00000100:00100000:0.0:1788521951.325743:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799145472 00000100:00100000:0.0:1788521951.325840:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:0.0:1788521951.325856:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+20:2363:x1875400799145472:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521951.325876:0:14411:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521951.325909:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031400/0x1b7b50db5927d1e1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e6a expref: 20 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.325936:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996fb19eff00) 00010000:00010000:0.0:1788521951.325942:0:14411:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521951.326019:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+19:2363:x1875400799145472:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 165us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521951.326027:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:3.0:1788521951.507709:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521951.507757:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521951.507793:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521951.507833:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521951.507866:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521951.507911:0:16497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799146112 00000100:00100000:2.0:1788521951.507914:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799146368 00000100:00100000:3.0:1788521951.507922:0:16497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799146112 00000100:00100000:2.0:1788521951.507931:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799146368 00000100:00100000:1.0:1788521951.508031:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799145984 00000100:00100000:1.0:1788521951.508042:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799145984 00000100:00100000:0.0:1788521951.508094:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799145856 00000100:00100000:0.0:1788521951.508101:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799145856 00000100:00100000:0.0:1788521951.508190:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 121 00000100:00100000:0.0:1788521951.508203:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+13:2361:x1875400799145856:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521951.508283:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a5bebd6-4a5a-4fe7-85c6-4a093a0b2439+13:2361:x1875400799145856:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 71us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521951.508489:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 121 00000100:00100000:2.0:1788521951.509326:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799146240 00000100:00100000:2.0:1788521951.509336:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799146240 00000100:00100000:2.0:1788521951.509374:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:2.0:1788521951.509386:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+5:2361:x1875400799146112:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521951.509502:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:1.0:1788521951.509513:0:15108:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788521951.509524:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+5:2361:x1875400799146368:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521951.509530:0:15108:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1788521951.509832:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:1.0:1788521951.509845:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+5:2361:x1875400799146240:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521951.510410:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+5:2361:x1875400799146112:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 1024us (2649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521951.510420:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:2.0:1788521951.510445:0:15106:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788521951.510455:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:2.0:1788521951.510463:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+5:2361:x1875400799145984:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521951.510543:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+5:2361:x1875400799146240:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 702us (2676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521951.510551:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00080000:1.0:1788521951.510679:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788521951.510685:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788521951.511586:0:16497:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:3.0:1788521951.511601:0:16497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_005' 00000100:00100000:0.0:1788521951.514656:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa516df2-6a20-4ac4-9ce7-f7e9e546f820+5:2361:x1875400799146368:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 5132us (6850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521951.514671:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:2.0:1788521951.514816:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+5:2361:x1875400799145984:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 4184us (6812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521951.514832:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:0.0:1788521951.595694:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521951.595816:0:16498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799146624 00000100:00100000:1.0:1788521951.595827:0:16498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799146624 00000100:00100000:1.0:1788521951.596227:0:16498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:1.0:1788521951.596237:0:16498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+19:14480:x1875400799146624:12345-192.168.206.48@tcp:101:cat.0 00010000:00010000:1.0:1788521951.596259:0:16498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521951.596279:0:16498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4c00/0x1b7b50db5927d1f6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00e71 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521951.596373:0:16498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927d1fd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521951.596388:0:16498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927d1fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521951.598799:0:16498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927d1fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521951.598829:0:16498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788521951.599022:0:16498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4c00/0x1b7b50db5927d1f6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e71 expref: 22 pid: 16498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521951.599045:0:16498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927d1fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e71 expref: 21 pid: 16498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521951.599054:0:16498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996fb19eff00) 00010000:00010000:1.0:1788521951.599058:0:16498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521951.599061:0:16498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d5000, rc 0) 00000100:00100000:1.0:1788521951.599636:0:16498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+21:14480:x1875400799146624:12345-192.168.206.48@tcp:101:cat.0 Request processed in 3398us (3949us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1788521951.599646:0:16498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:3.0:1788521951.612324:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521951.612363:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521951.612636:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799146752 00000100:00100000:0.0:1788521951.612646:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799146752 00000100:00100000:0.0:1788521951.612711:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:0.0:1788521951.612722:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+21:2363:x1875400799146752:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521951.612737:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521951.612780:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927d1fd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e71 expref: 21 pid: 16498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.612800:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996fb19eff00) 00010000:00010000:0.0:1788521951.612805:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521951.612861:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+20:2363:x1875400799146752:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 141us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521951.612868:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:2.0:1788521951.615393:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799147008 00000100:00100000:2.0:1788521951.615414:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799147008 00000100:00100000:2.0:1788521951.615657:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:2.0:1788521951.615669:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+20:14480:x1875400799147008:12345-192.168.206.48@tcp:35:cat.0 00000100:00100000:2.0:1788521951.616711:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+21:14480:x1875400799147008:12345-192.168.206.48@tcp:35:cat.0 Request processed in 1040us (4342us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788521951.616722:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 8 00010000:00010000:0.0:1788521951.631686:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521951.693684:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521951.693833:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799147264 00000100:00100000:2.0:1788521951.693854:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799147264 00000100:00100000:2.0:1788521951.693923:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 34 00000100:00100000:2.0:1788521951.693934:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+21:14486:x1875400799147264:12345-192.168.206.48@tcp:101:dd.0 00010000:00010000:2.0:1788521951.693982:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521951.694007:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927d20b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00e78 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.694129:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031600/0x1b7b50db5927d212 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.694196:0:14425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927d1b0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e55 expref: 22 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.694207:0:14425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927d1c5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e5c expref: 22 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.694216:0:14425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031600/0x1b7b50db5927d212 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.694464:0:14425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927d1c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e5c expref: 22 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.694502:0:14425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927d1c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e5c expref: 22 pid: 14426 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521951.694519:0:14425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82a63480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14425:1875400816957056:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788521951.694655:0:14425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927d1b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e55 expref: 22 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.694666:0:14425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927d1b0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e55 expref: 22 pid: 14427 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521951.694676:0:14425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996e82a62680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14425:1875400816957184:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788521951.694704:0:14425:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f84d89780 going to sleep for 11 seconds 00000100:00100000:1.0:1788521951.698868:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521951.698965:0:14425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82a63480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14425:1875400816957056:192.168.206.48@tcp:104: 00000100:00100000:1.0:1788521951.698967:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521951.698991:0:14425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996e82a62680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14425:1875400816957184:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788521951.699031:0:14425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031600/0x1b7b50db5927d212 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521951.699295:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799147392 00000100:00100000:0.0:1788521951.699305:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799147392 00000100:00100000:2.0:1788521951.699306:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799147520 00000100:00100000:2.0:1788521951.699317:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799147520 00010000:00010000:0.0:1788521951.699350:0:14412:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927d1c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e5c expref: 24 pid: 14426 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.699359:0:14410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927d1b0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e55 expref: 24 pid: 14427 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521951.699413:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:1.0:1788521951.699481:0:14411:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788521951.699492:0:14411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1788521951.699732:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f82afd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+24:2364:x1875400799147392:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521951.699754:0:14412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521951.699772:0:14412:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927d1c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e5c expref: 24 pid: 14426 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.699802:0:14412:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927d1c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e5c expref: 24 pid: 14426 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.699838:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030400/0x1b7b50db5927d1c5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e5c expref: 24 pid: 14426 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.699858:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996fb19eff00) 00010000:00010000:0.0:1788521951.699863:0:14412:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031600/0x1b7b50db5927d212 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.699873:0:14412:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031600/0x1b7b50db5927d212 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.699879:0:14412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521951.699951:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f82afd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+23:2364:x1875400799147392:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 527us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521951.704990:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:0.0:1788521951.705183:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:2.0:1788521951.705224:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+23:2364:x1875400799147520:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521951.705248:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521951.705261:0:14410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927d1b0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e55 expref: 23 pid: 14427 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.705288:0:14410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927d1b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e55 expref: 22 pid: 14427 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.705328:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031a00/0x1b7b50db5927d1b0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e55 expref: 22 pid: 14427 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.705348:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996fb19eff00) 00010000:00010000:2.0:1788521951.705353:0:14410:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031600/0x1b7b50db5927d212 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.705363:0:14410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031600/0x1b7b50db5927d212 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.705371:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031600/0x1b7b50db5927d212 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.705411:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521951.705465:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+21:2364:x1875400799147520:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 461us (6500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521951.705474:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 12 00010000:00010000:2.0:1788521951.705519:0:14425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031600/0x1b7b50db5927d212 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.705528:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031600/0x1b7b50db5927d212 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521951.705545:0:14425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788521951.705695:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927d20b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e78 expref: 22 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.705709:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031600/0x1b7b50db5927d212 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e78 expref: 21 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.706221:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996fb19eff00) 00010000:00010000:2.0:1788521951.706225:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788521951.706228:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f80031600, rc 0) 00000100:00100000:2.0:1788521951.706266:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+21:14486:x1875400799147264:12345-192.168.206.48@tcp:101:dd.0 Request processed in 12334us (12596us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788521951.706275:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 34 00000100:00100000:1.0:1788521951.710667:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521951.712402:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799147776 00000100:00100000:2.0:1788521951.712417:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799147776 00000100:00100000:2.0:1788521951.712483:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 35 00000100:00100000:2.0:1788521951.712493:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+21:14486:x1875400799147776:12345-192.168.206.48@tcp:36:dd.0 00010000:00010000:2.0:1788521951.712734:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031c00/0x1b7b50db5927d220 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.712751:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031c00/0x1b7b50db5927d220 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.712772:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031c00/0x1b7b50db5927d220 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788521951.712819:0:14426:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788521951.712853:0:14426:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003ba5b401 reply state 000000003daef92b transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031c00/0x1b7b50db5927d220 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521951.712862:0:14426:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788521951.713367:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+24:14486:x1875400799147776:12345-192.168.206.48@tcp:36:dd.0 Request processed in 872us (2711us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788521951.713376:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 35 00000020:00080000:2.0:1788521951.713397:0:14426:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788521951.719744:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031c00/0x1b7b50db5927d220 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.719781:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031c00/0x1b7b50db5927d220 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.721119:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031c00/0x1b7b50db5927d220 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.721195:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80031c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521951.721201:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031c00/0x1b7b50db5927d220 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.721296:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031c00/0x1b7b50db5927d220 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.721319:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996fb19eff00) 00010000:00010000:3.0:1788521951.721322:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521951.721329:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031c00/0x1b7b50db5927d220 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.721336:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031c00/0x1b7b50db5927d220 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521951.725449:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521951.725832:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799147904 00000100:00100000:0.0:1788521951.725845:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799147904 00000100:00100000:0.0:1788521951.725919:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:0.0:1788521951.725931:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+23:14486:x1875400799147904:12345-192.168.206.48@tcp:101:dd.0 00010000:00010000:0.0:1788521951.725962:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521951.725992:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927d227 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00e7f expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.726063:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927d227 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e7f expref: 24 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.726079:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927d227 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e7f expref: 24 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521951.726123:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996fb19eff00) 00010000:00010000:0.0:1788521951.726126:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788521951.726131:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fb4000200, rc 0) 00000100:00100000:0.0:1788521951.726247:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+24:14486:x1875400799147904:12345-192.168.206.48@tcp:101:dd.0 Request processed in 318us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521951.726254:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:0.0:1788521951.737598:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521951.737700:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799148160 00000100:00100000:3.0:1788521951.737714:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799148160 00000100:00100000:3.0:1788521951.737813:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:3.0:1788521951.737826:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+24:14486:x1875400799148160:12345-192.168.206.48@tcp:103:dd.0 00010000:00010000:3.0:1788521951.737847:0:14412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521951.737882:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000200/0x1b7b50db5927d227 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e7f expref: 24 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521951.737906:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996fb19eff00) 00010000:00010000:3.0:1788521951.737913:0:14412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521951.737987:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+23:14486:x1875400799148160:12345-192.168.206.48@tcp:103:dd.0 Request processed in 164us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521951.737994:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:3.0:1788521951.740305:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521951.740412:0:16498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799148288 00000100:00100000:1.0:1788521951.740425:0:16498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799148288 00000100:00100000:1.0:1788521951.740495:0:16498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 37 00000100:00100000:1.0:1788521951.740506:0:16498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+23:14486:x1875400799148288:12345-192.168.206.48@tcp:58:dd.0 00010000:00010000:1.0:1788521951.740626:0:16498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927d22e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521951.740647:0:16498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927d22e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521951.740663:0:16498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927d22e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788521951.741590:0:16498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788521951.741774:0:16498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1788521951.741855:0:16498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1788521951.741996:0:16498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+23:14486:x1875400799148288:12345-192.168.206.48@tcp:58:dd.0 Request processed in 1487us (1700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521951.742008:0:16498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 37 00000100:00100000:1.0:1788521951.744925:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521951.745138:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799148416 00000100:00100000:2.0:1788521951.745180:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799148416 00000100:00100000:2.0:1788521951.745303:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 38 00000100:00100000:2.0:1788521951.745314:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+23:14486:x1875400799148416:12345-192.168.206.48@tcp:101:dd.0 00010000:00010000:2.0:1788521951.745339:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521951.745365:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927d235 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00e86 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.745443:0:14425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927d22e lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.745455:0:14425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927d235 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e86 expref: 24 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.745491:0:14425:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927d22e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.745507:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927d235 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e86 expref: 24 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.745523:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996fb19eff00) 00010000:00010000:2.0:1788521951.745526:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788521951.745531:0:14425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927d235 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e86 expref: 24 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521951.745538:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f80030600, rc 0) 00000100:00100000:2.0:1788521951.745610:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+24:14486:x1875400799148416:12345-192.168.206.48@tcp:101:dd.0 Request processed in 297us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521951.745639:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 38 00000040:00080000:0.0:1788521952.015007:0:14457:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788521952.015021:0:14457:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788521952.015063:0:14457:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788521952.015072:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788521952.015874:0:14457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb7f42680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14457:1875400816957312:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788521952.016453:0:14457:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f86583300 going to sleep for 11 seconds 00000100:00100000:0.0:1788521952.021620:0:14457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb7f42680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14457:1875400816957312:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788521952.026099:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521952.026283:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799148544 00000100:00100000:0.0:1788521952.026292:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799148544 00000100:00100000:0.0:1788521952.026360:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:0.0:1788521952.026373:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+24:14487:x1875400799148544:12345-192.168.206.48@tcp:900:lhsmtool_posix.0 00000100:00080000:1.0:1788521952.026397:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521952.026454:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+24:14487:x1875400799148544:12345-192.168.206.48@tcp:900:lhsmtool_posix.0 Request processed in 84us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521952.026474:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:1.0:1788521952.029635:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521952.029716:0:16498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799148672 00000100:00100000:3.0:1788521952.029726:0:16498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799148672 00000100:00100000:3.0:1788521952.029832:0:16498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 39 00000100:00100000:3.0:1788521952.029843:0:16498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+24:14487:x1875400799148672:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788521952.029893:0:16498:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788521952.029995:0:16498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+24:14487:x1875400799148672:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 153us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521952.030003:0:16498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 39 00000100:00100000:3.0:1788521952.034814:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521952.037549:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799148800 00000100:00100000:0.0:1788521952.037564:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799148800 00000100:00100000:0.0:1788521952.037654:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 40 00000100:00100000:0.0:1788521952.037665:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+24:14487:x1875400799148800:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788521952.037746:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001a00/0x1b7b50db5927d23c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.037773:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001a00/0x1b7b50db5927d23c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.037789:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001a00/0x1b7b50db5927d23c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.037839:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927d243 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.037848:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927d243 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.037854:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927d243 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.037878:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927d24a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.037886:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927d24a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.037892:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927d24a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521952.037925:0:14427:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788521952.037929:0:14427:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788521952.037941:0:14427:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927d24a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.037951:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001a00/0x1b7b50db5927d23c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.037964:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001a00/0x1b7b50db5927d23c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.037970:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001a00/0x1b7b50db5927d23c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.037974:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4001a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521952.037978:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001a00/0x1b7b50db5927d23c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.037985:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001a00/0x1b7b50db5927d23c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.037995:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996f83d6de00) 00010000:00010000:0.0:1788521952.037998:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521952.038003:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001a00/0x1b7b50db5927d23c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.038008:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001a00/0x1b7b50db5927d23c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.038018:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927d243 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.038023:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927d243 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.038028:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927d243 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.038032:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521952.038041:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927d243 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.038047:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927d243 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.038054:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff996f83d6d400) 00010000:00010000:0.0:1788521952.038056:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521952.038059:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927d243 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.038065:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000000/0x1b7b50db5927d243 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.038079:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927d24a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.038084:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927d24a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.038089:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927d24a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.038093:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521952.038096:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927d24a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.038102:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927d24a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.038108:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996fb19eff00) 00010000:00010000:0.0:1788521952.038110:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521952.038119:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927d24a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.038125:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000800/0x1b7b50db5927d24a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521952.038264:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+24:14487:x1875400799148800:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 Request processed in 600us (3457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521952.038272:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 40 00000100:00100000:0.0:1788521952.043625:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521952.043720:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799149056 00000100:00100000:2.0:1788521952.043730:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799149056 00000100:00100000:2.0:1788521952.043801:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 41 00000100:00100000:2.0:1788521952.043812:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+24:14487:x1875400799149056:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521952.043833:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521952.043853:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030c00/0x1b7b50db5927d251 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00e8d expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.043956:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d258 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.043970:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d258 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.043982:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d258 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521952.043992:0:14426:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788521952.044088:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d258 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.044096:0:14426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d258 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.044102:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d258 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.044108:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80031800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521952.044112:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d258 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.044127:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d258 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.044170:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996fb19eff00) 00010000:00010000:2.0:1788521952.044173:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788521952.044178:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d258 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.044184:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d258 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.044238:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030c00/0x1b7b50db5927d251 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e8d expref: 26 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.044248:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996f83d6de00) 00010000:00010000:2.0:1788521952.044250:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521952.044254:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030c00/0x1b7b50db5927d251 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e8d expref: 26 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.044263:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f80030c00, rc 0) 00000100:00100000:2.0:1788521952.044321:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+25:14487:x1875400799149056:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 511us (705us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1788521952.044328:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 41 00000100:00100000:1.0:1788521952.053058:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521952.053187:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799149184 00000100:00100000:0.0:1788521952.053197:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799149184 00000100:00100000:0.0:1788521952.053253:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 42 00000100:00100000:0.0:1788521952.053263:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+25:14487:x1875400799149184:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788521952.053296:0:14427:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788521952.053396:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+25:14487:x1875400799149184:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 134us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521952.053403:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 42 00000100:00100000:0.0:1788521952.057005:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521952.057975:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799149440 00000100:00100000:2.0:1788521952.057985:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799149440 00000100:00100000:2.0:1788521952.058039:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 43 00000100:00100000:2.0:1788521952.058048:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+25:14487:x1875400799149440:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521952.058090:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521952.058108:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030c00/0x1b7b50db5927d266 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00e94 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788521952.058697:0:14426:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:2.0:1788521952.058704:0:14426:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1788521952.058755:0:14426:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1788521952.059614:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d26d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.059631:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d26d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.059643:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d26d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.059697:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030c00/0x1b7b50db5927d266 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e94 expref: 28 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.059715:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d26d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e94 expref: 27 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.059723:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996fb19ef500) 00010000:00010000:2.0:1788521952.059726:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521952.059729:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f80031800, rc 0) 00000100:00100000:2.0:1788521952.060265:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+27:14487:x1875400799149440:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 2215us (3265us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1788521952.060274:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 43 00000100:00100000:3.0:1788521952.065437:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521952.065529:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799149696 00000100:00100000:2.0:1788521952.065550:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799149696 00000100:00100000:2.0:1788521952.065609:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 44 00000100:00100000:2.0:1788521952.065620:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82a60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+27:14487:x1875400799149696:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788521952.065674:0:14425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521952.065701:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80031800/0x1b7b50db5927d26d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e94 expref: 27 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.065721:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996fb19ef500) 00010000:00010000:2.0:1788521952.065731:0:14425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521952.065752:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030c00/0x1b7b50db5927d27b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.065775:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030c00/0x1b7b50db5927d27b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.065786:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030c00/0x1b7b50db5927d27b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.065847:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030200/0x1b7b50db5927d282 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5bf4036f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.065856:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030200/0x1b7b50db5927d282 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5bf4036f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.065863:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030200/0x1b7b50db5927d282 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5bf4036f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.068396:0:14425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030c00/0x1b7b50db5927d27b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.068424:0:14425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030c00/0x1b7b50db5927d27b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.068445:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030c00/0x1b7b50db5927d27b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.068451:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80030c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521952.068455:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030c00/0x1b7b50db5927d27b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.068463:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030c00/0x1b7b50db5927d27b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.068478:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff996f83d40000) 00010000:00010000:2.0:1788521952.068481:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521952.068485:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030c00/0x1b7b50db5927d27b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.068490:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030c00/0x1b7b50db5927d27b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.068505:0:14425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030200/0x1b7b50db5927d282 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5bf4036f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.068512:0:14425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030200/0x1b7b50db5927d282 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5bf4036f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.068518:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030200/0x1b7b50db5927d282 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5bf4036f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.068522:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80030200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1788521952.068525:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030200/0x1b7b50db5927d282 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5bf4036f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.068539:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030200/0x1b7b50db5927d282 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5bf4036f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.068548:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x5bf4036f (ffff996fb19ef000) 00010000:00010000:2.0:1788521952.068550:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521952.068553:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030200/0x1b7b50db5927d282 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5bf4036f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.068560:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030200/0x1b7b50db5927d282 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5bf4036f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521952.068666:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82a60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+26:14487:x1875400799149696:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 3045us (3234us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788521952.068675:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 44 00000100:00100000:1.0:1788521952.073349:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521952.073443:0:16498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799149824 00000100:00100000:3.0:1788521952.073452:0:16498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799149824 00000100:00100000:3.0:1788521952.073542:0:16498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 45 00000100:00100000:3.0:1788521952.073554:0:16498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+26:14487:x1875400799149824:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521952.073573:0:16498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521952.073595:0:16498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4e00/0x1b7b50db5927d289 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00e9b expref: -99 pid: 16498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.073629:0:16498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4400/0x1b7b50db5927d290 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.073642:0:16498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4400/0x1b7b50db5927d290 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.073652:0:16498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4400/0x1b7b50db5927d290 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.073756:0:16498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4e00/0x1b7b50db5927d289 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e9b expref: 28 pid: 16498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.073785:0:16498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4400/0x1b7b50db5927d290 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e9b expref: 27 pid: 16498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.073794:0:16498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996f83d40b00) 00010000:00010000:3.0:1788521952.073797:0:16498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788521952.073800:0:16498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f829d4400, rc 0) 00000100:00100000:3.0:1788521952.073862:0:16498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+27:14487:x1875400799149824:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 311us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521952.073870:0:16498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 45 00000100:00100000:0.0:1788521952.079775:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521952.079974:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799150080 00000100:00100000:1.0:1788521952.079985:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799150080 00000100:00100000:1.0:1788521952.080042:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00100000:1.0:1788521952.080053:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+27:14487:x1875400799150080:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788521952.080127:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927d297 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.080168:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927d297 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.080181:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927d297 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788521952.080486:0:14427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1788521952.080496:0:14427:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 452065353170ns, next at 453065350917ns, rc = 0 00000004:00010000:1.0:1788521952.080576:0:14427:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2d3a12f reply state 00000000ad3ca336 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927d297 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521952.080604:0:14427:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788521952.080701:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+29:14487:x1875400799150080:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 649us (942us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1788521952.080708:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 46 00010000:00010000:3.0:1788521952.086079:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927d297 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.086097:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927d297 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.086105:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927d297 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.086111:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521952.086117:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927d297 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.086125:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927d297 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.086158:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996f83d40b00) 00010000:00010000:3.0:1788521952.086173:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788521952.086180:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927d297 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.086187:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5800/0x1b7b50db5927d297 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521952.089287:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521952.089432:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799150208 00000100:00100000:3.0:1788521952.089441:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799150208 00000100:00100000:3.0:1788521952.089489:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 47 00000100:00100000:3.0:1788521952.089499:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+28:14487:x1875400799150208:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521952.089521:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521952.089541:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4e00/0x1b7b50db5927d29e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00ea2 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.089601:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4e00/0x1b7b50db5927d29e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ea2 expref: 29 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.089617:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4e00/0x1b7b50db5927d29e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ea2 expref: 29 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.089635:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996f83d40b00) 00010000:00010000:3.0:1788521952.089639:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788521952.089642:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f829d4e00, rc 0) 00000100:00100000:3.0:1788521952.089691:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+29:14487:x1875400799150208:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 193us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521952.089697:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 47 00000100:00100000:0.0:1788521952.094125:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521952.094244:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799150336 00000100:00100000:1.0:1788521952.094253:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799150336 00000100:00100000:1.0:1788521952.094305:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:1.0:1788521952.094316:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+5:2363:x1875400799150336:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788521952.094656:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+6:2363:x1875400799150336:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 341us (538us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788521952.094664:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:0.0:1788521952.097334:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521952.097430:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799150592 00000100:00100000:3.0:1788521952.097439:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799150592 00000100:00100000:3.0:1788521952.097509:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:3.0:1788521952.097519:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+29:14487:x1875400799150592:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788521952.097728:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+30:14487:x1875400799150592:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 210us (401us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1788521952.097736:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:0.0:1788521952.101434:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521952.101574:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799150848 00000100:00100000:1.0:1788521952.101583:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799150848 00000100:00100000:1.0:1788521952.101646:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 48 00000100:00100000:1.0:1788521952.101656:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+30:14487:x1875400799150848:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788521952.101775:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+30:14487:x1875400799150848:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 119us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521952.101783:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 48 00000100:00100000:0.0:1788521952.108306:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521952.108503:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799150976 00000100:00100000:3.0:1788521952.108513:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799150976 00000100:00100000:3.0:1788521952.108569:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 49 00000100:00100000:3.0:1788521952.108580:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+30:14487:x1875400799150976:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521952.108600:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521952.108620:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d2a5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00ea9 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.108683:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5000/0x1b7b50db5927d2ac lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.108697:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5000/0x1b7b50db5927d2ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.108709:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5000/0x1b7b50db5927d2ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521952.108744:0:14426:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788521952.108778:0:14426:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5000/0x1b7b50db5927d2ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.108875:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d2a5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ea9 expref: 32 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.108913:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5000/0x1b7b50db5927d2ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ea9 expref: 31 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.108921:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996f83d40b00) 00010000:00010000:3.0:1788521952.108924:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788521952.108928:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f829d5000, rc 0) 00000100:00100000:3.0:1788521952.109082:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+31:14487:x1875400799150976:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 503us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521952.109090:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 49 00000100:00100000:2.0:1788521952.123574:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521952.123900:0:16651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799151104 00000100:00100000:1.0:1788521952.123911:0:16651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799151104 00000100:00100000:1.0:1788521952.124006:0:16651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:1.0:1788521952.124017:0:16651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82f9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+6:2361:x1875400799151104:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788521952.124034:0:16651:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521952.124056:0:16651:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013f420e2/0x1b7b50db5927d2b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00eb0 expref: -99 pid: 16651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788521952.124093:0:16651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9aade0, blocks: 0x1 00010000:00010000:1.0:1788521952.124111:0:16651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1788521952.124115:0:16651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521952.124124:0:16651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013f420e2/0x1b7b50db5927d2b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00eb0 expref: 7 pid: 16651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.124167:0:16651:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000013f420e2/0x1b7b50db5927d2b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00eb0 expref: 7 pid: 16651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.124181:0:16651:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996fbc6d5400, rc 0) 00000100:00100000:1.0:1788521952.124246:0:16651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82f9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+7:2361:x1875400799151104:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 230us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521952.124254:0:16651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:0.0:1788521952.135380:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521952.135475:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799151360 00000100:00100000:1.0:1788521952.135485:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799151360 00000100:00100000:1.0:1788521952.135544:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 50 00000100:00100000:1.0:1788521952.135554:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+31:14487:x1875400799151360:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788521952.135655:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+31:14487:x1875400799151360:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 102us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521952.135662:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 50 00000100:00100000:0.0:1788521952.142569:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521952.142989:0:16498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799151488 00000100:00100000:1.0:1788521952.143000:0:16498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799151488 00000100:00100000:1.0:1788521952.143061:0:16498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 51 00000100:00100000:1.0:1788521952.143071:0:16498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+31:14487:x1875400799151488:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788521952.220168:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:0.0:1788521952.220193:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934593 is committed 00000001:00080000:0.0:1788521952.220200:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:0.0:1788521952.220205:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788521952.220259:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00100000:1.0:1788521952.220413:0:16498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+14:14487:x1875400799151488:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 Request processed in 77338us (77847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521952.220424:0:16498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 51 00000100:00100000:3.0:1788521952.220638:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788521952.220652:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816957440:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788521952.220699:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521952.220756:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816957440 00000100:00100000:3.0:1788521952.220772:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816957440 00000100:00100000:3.0:1788521952.221428:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788521952.221437:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875400816957440:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788521952.221578:0:15107:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788521952.221582:0:15107:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788521952.221585:0:15107:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788521952.221587:0:15107:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788521952 -> 1788521952 00002000:00010000:3.0:1788521952.221589:0:15107:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788521952.221623:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875400816957440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 189us (923us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788521952.221630:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:3.0:1788521952.221670:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff996f98073b80/2, rc 0, transno 8589934595 00000100:00100000:3.0:1788521952.221684:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875400816957440:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1788521952.223505:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521952.223984:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521952.224280:0:16650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799151616 00000100:00100000:3.0:1788521952.224288:0:16650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799151616 00000100:00100000:3.0:1788521952.224348:0:16650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:3.0:1788521952.224359:0:16650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82f9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+7:2363:x1875400799151616:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788521952.224477:0:16650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82f9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+7:2363:x1875400799151616:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 Request processed in 120us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521952.224484:0:16650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:0.0:1788521952.230857:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521952.230954:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799151872 00000100:00100000:1.0:1788521952.230964:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799151872 00000100:00100000:1.0:1788521952.231055:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 52 00000100:00100000:1.0:1788521952.231080:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+14:14487:x1875400799151872:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788521952.231129:0:14427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521952.231189:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5000/0x1b7b50db5927d2ac lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ea9 expref: 14 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.231208:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996f83d40b00) 00010000:00010000:1.0:1788521952.231214:0:14427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788521952.231241:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927d2ba lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.231253:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927d2ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.231263:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927d2ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788521952.231435:0:14427:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd81e179 reply state 00000000b2710e98 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927d2ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521952.231445:0:14427:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788521952.231537:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+15:14487:x1875400799151872:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 459us (689us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1788521952.231560:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 52 00010000:00010000:3.0:1788521952.234956:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927d2ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.234972:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927d2ba lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.234979:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927d2ba lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.234985:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1788521952.234990:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927d2ba lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.234997:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927d2ba lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.235013:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996f83d40b00) 00010000:00010000:3.0:1788521952.235016:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521952.235020:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927d2ba lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.235025:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d5000/0x1b7b50db5927d2ba lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521952.237864:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521952.240264:0:16497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799152000 00000100:00100000:3.0:1788521952.240277:0:16497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799152000 00000100:00100000:3.0:1788521952.240356:0:16497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:3.0:1788521952.240367:0:16497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+7:14487:x1875400799152000:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521952.240384:0:16497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521952.240414:0:16497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927d2c1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe705d7355cd00eb7 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.240448:0:16497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000013f420e2/0x1b7b50db5927d2b3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00eb0 expref: 8 pid: 16651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.240458:0:16497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521952.240463:0:16497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521952.240469:0:16497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927d2c1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00eb7 expref: 8 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.240507:0:16497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000013f420e2/0x1b7b50db5927d2b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00eb0 expref: 8 pid: 16651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.240529:0:16497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000013f420e2/0x1b7b50db5927d2b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00eb0 expref: 8 pid: 16651 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521952.240543:0:16497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16497:1875400816957568:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788521952.240631:0:16497:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb47d3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521952.250007:0:16497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16497:1875400816957568:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788521952.250056:0:16497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927d2c1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00eb7 expref: 8 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.250077:0:16497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996f829d5400, rc 0) 00000100:00100000:3.0:1788521952.250138:0:16497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+8:14487:x1875400799152000:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 9772us (12281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521952.250189:0:16497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:2.0:1788521952.254727:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788521952.256226:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799152128 00000100:00100000:1.0:1788521952.256237:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799152128 00010000:00010000:0.0:1788521952.261049:0:14411:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000013f420e2/0x1b7b50db5927d2b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00eb0 expref: 8 pid: 16651 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521952.261235:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:0.0:1788521952.261246:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82f9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+8:2364:x1875400799152128:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521952.261261:0:14411:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521952.261283:0:14411:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000013f420e2/0x1b7b50db5927d2b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00eb0 expref: 8 pid: 16651 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.261304:0:14411:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000013f420e2/0x1b7b50db5927d2b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00eb0 expref: 8 pid: 16651 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.261327:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013f420e2/0x1b7b50db5927d2b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00eb0 expref: 8 pid: 16651 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.261346:0:14411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521952.261351:0:14411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521952.261357:0:14411:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927d2c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00eb7 expref: 7 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.261387:0:14411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927d2c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00eb7 expref: 7 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.261425:0:14411:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927d2c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00eb7 expref: 7 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521952.261440:0:14411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc3eed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14411:1875400816957696:192.168.206.48@tcp:105: 00000100:00100000:0.0:1788521952.262513:0:14411:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f84d89cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521952.276709:0:14411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc3eed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14411:1875400816957696:192.168.206.48@tcp:105: 00010000:00010000:2.0:1788521952.276737:0:14411:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521952.276804:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82f9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+7:2364:x1875400799152128:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 15560us (22085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521952.276815:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:2.0:1788521952.279900:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521952.279990:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799152256 00000100:00100000:3.0:1788521952.279999:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799152256 00000100:00100000:3.0:1788521952.280052:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:3.0:1788521952.280071:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996e82f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+7:2363:x1875400799152256:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788521952.280289:0:15107:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788521952.280294:0:15107:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788521952 00002000:00010000:3.0:1788521952.280297:0:15107:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788521951 00002000:00010000:3.0:1788521952.280298:0:15107:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788521952 -> 1788521952 00002000:00010000:3.0:1788521952.280300:0:15107:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788521952.280350:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996e82f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+8:2363:x1875400799152256:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 289us (458us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788521952.280358:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:0.0:1788521952.284413:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521952.284564:0:16650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799152384 00000100:00100000:3.0:1788521952.284573:0:16650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799152384 00000100:00100000:3.0:1788521952.284672:0:16650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:3.0:1788521952.284683:0:16650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+8:2363:x1875400799152384:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788521952.284727:0:16650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927d2c8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.284768:0:16650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927d2c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00eb7 expref: 8 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.284778:0:16650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521952.284783:0:16650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521952.284788:0:16650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927d2c8 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.284823:0:16650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927d2c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00eb7 expref: 8 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.284846:0:16650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927d2c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00eb7 expref: 8 pid: 16497 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521952.284861:0:16650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16650:1875400816957824:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788521952.284942:0:16650:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb47d3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521952.290802:0:16650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16650:1875400816957824:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788521952.290832:0:16650:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927d2c8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521952.292564:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521952.292700:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799152512 00000100:00100000:2.0:1788521952.292709:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799152512 00010000:00010000:2.0:1788521952.292747:0:14410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927d2c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00eb7 expref: 9 pid: 16497 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521952.292820:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:2.0:1788521952.292830:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+9:2364:x1875400799152512:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521952.292845:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521952.292866:0:14410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927d2c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00eb7 expref: 9 pid: 16497 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.292888:0:14410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927d2c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00eb7 expref: 9 pid: 16497 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.292913:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078ac0797/0x1b7b50db5927d2c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00eb7 expref: 9 pid: 16497 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.292930:0:14410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788521952.292934:0:14410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788521952.292940:0:14410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927d2c8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.292949:0:14410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927d2c8 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.293025:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521952.293086:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+8:2364:x1875400799152512:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 257us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521952.293094:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 14 00010000:00010000:0.0:1788521952.294288:0:16650:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927d2c8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.294305:0:16650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927d2c8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.294333:0:16650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927d2c8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.294342:0:16650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927d2c8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.294351:0:16650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927d2c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.294371:0:16650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d5000 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:0.0:1788521952.294376:0:16650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927d2c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.294385:0:16650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927d2c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.294399:0:16650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927d2c8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.294407:0:16650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb7185ef/0x1b7b50db5927d2c8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521952.294525:0:16650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+7:2363:x1875400799152384:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 Request processed in 9839us (10115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521952.294535:0:16650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:0.0:1788521952.297739:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521952.297874:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799152768 00000100:00100000:3.0:1788521952.297883:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799152768 00000100:00100000:3.0:1788521952.297940:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 53 00000100:00100000:3.0:1788521952.297951:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+14:14487:x1875400799152768:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788521952.298051:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d2cf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.298068:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d2cf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.298081:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d2cf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.298504:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d2d6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.298517:0:14426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4e00/0x1b7b50db5927d29e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ea2 expref: 15 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.298526:0:14426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d2d6 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.298559:0:14426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4e00/0x1b7b50db5927d29e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ea2 expref: 15 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.298580:0:14426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4e00/0x1b7b50db5927d29e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ea2 expref: 15 pid: 14426 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521952.298595:0:14426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14426:1875400816957952:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788521952.298874:0:14426:0:(client.c:2716:ptlrpc_set_wait()) set ffff996fb47d3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521952.301829:0:14426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14426:1875400816957952:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788521952.301856:0:14426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d2d6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521952.305860:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521952.306063:0:16652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799152896 00000100:00100000:3.0:1788521952.306073:0:16652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799152896 00010000:00010000:3.0:1788521952.306113:0:16652:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4e00/0x1b7b50db5927d29e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ea2 expref: 16 pid: 14426 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521952.306218:0:16652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:3.0:1788521952.306229:0:16652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+16:2363:x1875400799152896:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521952.306245:0:16652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521952.306252:0:16652:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4e00/0x1b7b50db5927d29e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ea2 expref: 16 pid: 14426 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.306273:0:16652:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4e00/0x1b7b50db5927d29e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ea2 expref: 16 pid: 14426 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.306295:0:16652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4e00/0x1b7b50db5927d29e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00ea2 expref: 16 pid: 14426 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.306311:0:16652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996f83d40b00) 00010000:00010000:3.0:1788521952.306317:0:16652:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d2d6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.306326:0:16652:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d2d6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.306334:0:16652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d2d6 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.306359:0:16652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521952.306415:0:16652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+15:2363:x1875400799152896:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 188us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521952.306423:0:16652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 15 00010000:00010000:0.0:1788521952.306486:0:14426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d2d6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.306495:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d2d6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788521952.306672:0:14426:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1788521952.306807:0:14426:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1788521952.306853:0:14426:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1788521952.306920:0:14426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc3ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14426:1875400816958080:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788521952.307011:0:14426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521952.307046:0:14426:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f84d89cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521952.307116:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816958080 00000100:00100000:1.0:1788521952.307121:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816958080 00000100:00100000:1.0:1788521952.307184:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788521952.307192:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14426:x1875400816958080:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788521952.307256:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14426:x1875400816958080:12345-0@lo:1000:mdt00_001.0 Request processed in 66us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521952.307263:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788521952.307482:0:14426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc3ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14426:1875400816958080:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788521952.308097:0:14426:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1788521952.308177:0:14426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc3ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14426:1875400816958208:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788521952.308466:0:14426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521952.308492:0:14426:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f84d893c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521952.308534:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816958208 00000100:00100000:1.0:1788521952.308540:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816958208 00000100:00100000:1.0:1788521952.308569:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788521952.308576:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14426:x1875400816958208:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788521952.308735:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14426:x1875400816958208:12345-0@lo:1000:mdt00_001.0 Request processed in 158us (268us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788521952.308742:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788521952.310064:0:14426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc3ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14426:1875400816958208:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788521952.310108:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d2d6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.310118:0:14426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d2d6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.310125:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d2d6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.310131:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d5400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521952.310135:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d2d6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.310161:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d2d6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.310177:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996f83d40b00) 00010000:00010000:0.0:1788521952.310180:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788521952.310185:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d2d6 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.310208:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d5400/0x1b7b50db5927d2d6 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.310432:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927d22e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.310438:0:14426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927d22e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.310444:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927d22e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.310448:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d4a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521952.310451:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927d22e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.310457:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927d22e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.310466:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996fb19eff00) 00010000:00010000:0.0:1788521952.310468:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788521952.310476:0:14426:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927d235 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e86 expref: 18 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.310487:0:14426:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927d235 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e86 expref: 18 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.310495:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927d235 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e86 expref: 18 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.310566:0:14426:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff996f80030600/0x1b7b50db5927d235 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xe705d7355cd00e86 expref: 18 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521952.310580:0:14426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fbc3eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14426:1875400816958336:192.168.206.48@tcp:105: 00000100:00100000:0.0:1788521952.310709:0:14426:0:(client.c:2716:ptlrpc_set_wait()) set ffff996f84d89b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788521952.315507:0:14426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fbc3eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14426:1875400816958336:192.168.206.48@tcp:105: 00010000:00010000:0.0:1788521952.315541:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927d22e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.315552:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fbc6d4a00/0x1b7b50db5927d22e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.315584:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927d2dd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.315598:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927d2dd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.315609:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927d2dd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.315620:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927d2dd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.315627:0:14426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927d2dd lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.315633:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927d2dd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.315655:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4001800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521952.315659:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927d2dd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.315667:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927d2dd lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.315678:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996fb19eff00) 00010000:00010000:0.0:1788521952.315681:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521952.315685:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927d2dd lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.315691:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4001800/0x1b7b50db5927d2dd lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.315702:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d2cf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.315708:0:14426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d2cf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.315714:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d2cf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.315718:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d4200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1788521952.315722:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d2cf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.315728:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d2cf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.315746:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996fb19eff00) 00010000:00010000:0.0:1788521952.315748:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788521952.315751:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d2cf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.315756:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996f829d4200/0x1b7b50db5927d2cf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521952.316065:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+18:14487:x1875400799152768:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 18114us (18333us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788521952.316075:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 53 00000020:00080000:0.0:1788521952.316081:0:14426:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788521952.316294:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521952.316803:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799153024 00000100:00100000:0.0:1788521952.316811:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799153024 00000100:00100000:0.0:1788521952.316848:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:0.0:1788521952.316857:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb7db2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+18:14486:x1875400799153024:12345-192.168.206.48@tcp:49:dd.0 00000100:00100000:0.0:1788521952.316963:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb7db2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+18:14486:x1875400799153024:12345-192.168.206.48@tcp:49:dd.0 Request processed in 106us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521952.316971:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 10 00000040:00080000:1.0:1788521952.321502:0:14457:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788521952.321511:0:14457:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1788521952.321535:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000040:00080000:1.0:1788521952.321547:0:14457:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788521952.321556:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788521952.321883:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799153280 00000100:00100000:0.0:1788521952.321892:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799153280 00000100:00100000:0.0:1788521952.321943:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:0.0:1788521952.321954:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f860d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+18:14487:x1875400799153280:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788521952.322600:0:14428:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788521952.322705:0:14428:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1788521952.322747:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927d2e4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.322782:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927d2e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.322793:0:14428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927d2e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.322801:0:14428:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927d2e4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.322807:0:14428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927d2e4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.322814:0:14428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927d2e4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.322843:0:14428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788521952.322926:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f860d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+20:14487:x1875400799153280:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 973us (1395us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788521952.322934:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 11 00000020:00080000:0.0:1788521952.322939:0:14428:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788521952.323119:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521952.323126:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927d2e4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.323134:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000600 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:1.0:1788521952.323139:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927d2e4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.323207:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927d2e4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.327343:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996f83d40b00) 00010000:00010000:1.0:1788521952.327352:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788521952.327361:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927d2e4 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.327371:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996fb4000600/0x1b7b50db5927d2e4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.327391:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521952.327393:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521952.327396:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521952.505603:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521952.505663:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788521952.505703:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521952.505794:0:15113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799153408 00000100:00100000:0.0:1788521952.505805:0:15113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799153408 00000100:00100000:2.0:1788521952.505813:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799153536 00000100:00100000:2.0:1788521952.505820:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799153536 00000100:00100000:0.0:1788521952.505856:0:15113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799153664 00000100:00100000:0.0:1788521952.505860:0:15113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799153664 00000100:00100000:2.0:1788521952.505864:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:2.0:1788521952.505876:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+9:2363:x1875400799153408:12345-192.168.206.48@tcp:4:dd.0 00002000:00010000:2.0:1788521952.505920:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9aade0, atime: 0x6a9aaddf, ctime: 0x6a9aade0, blocks: 0x1 00010000:00010000:2.0:1788521952.505929:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae148880/0x1b7b50db5927d2eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.505945:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788521952.505950:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521952.505956:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae148880/0x1b7b50db5927d2eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.505971:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae148880/0x1b7b50db5927d2eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788521952.598913:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:0.0:1788521952.598930:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:00080000:0.0:1788521952.598938:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:1.0:1788521952.599173:0:15114:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:1.0:1788521952.599178:0:15114:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1788521952.599192:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae148880/0x1b7b50db5927d2eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.599205:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae148880/0x1b7b50db5927d2eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.599387:0:15114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae148880/0x1b7b50db5927d2eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.599394:0:15114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80030000 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:1.0:1788521952.599399:0:15114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae148880/0x1b7b50db5927d2eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.599443:0:15114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae148880/0x1b7b50db5927d2eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.599463:0:15114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae148880/0x1b7b50db5927d2eb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.599471:0:15114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae148880/0x1b7b50db5927d2eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521952.599568:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+7:2363:x1875400799153408:12345-192.168.206.48@tcp:4:dd.0 Request processed in 93691us (93968us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1788521952.599583:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:1.0:1788521952.599614:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:1.0:1788521952.599624:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+6:2363:x1875400799153536:12345-192.168.206.48@tcp:4:dd.0 00002000:00010000:1.0:1788521952.599662:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 1048576, mtime: 0x6a9aade0, atime: 0x6a9aaddf, ctime: 0x0, blocks: 0x803 00010000:00010000:1.0:1788521952.599668:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e49fe2c/0x1b7b50db5927d2f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.599678:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1788521952.599682:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521952.599688:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e49fe2c/0x1b7b50db5927d2f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.599701:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e49fe2c/0x1b7b50db5927d2f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.654623:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788521952.704676:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:2.0:1788521952.704963:0:15114:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:2.0:1788521952.704970:0:15114:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:2.0:1788521952.704984:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e49fe2c/0x1b7b50db5927d2f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.705018:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e49fe2c/0x1b7b50db5927d2f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.705027:0:15114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e49fe2c/0x1b7b50db5927d2f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.705035:0:15114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d4800 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:2.0:1788521952.705040:0:15114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e49fe2c/0x1b7b50db5927d2f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.705051:0:15114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e49fe2c/0x1b7b50db5927d2f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.705071:0:15114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e49fe2c/0x1b7b50db5927d2f2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.705080:0:15114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e49fe2c/0x1b7b50db5927d2f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521952.705220:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+6:2363:x1875400799153536:12345-192.168.206.48@tcp:4:dd.0 Request processed in 105594us (199552us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788521952.705230:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:2.0:1788521952.705258:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:2.0:1788521952.705269:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98073100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+5:2363:x1875400799153664:12345-192.168.206.48@tcp:4:dd.0 00002000:00010000:2.0:1788521952.705306:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6a9aade0, atime: 0x6a9aaddf, ctime: 0x0, blocks: 0x1007 00010000:00010000:2.0:1788521952.705319:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087c5a5d4/0x1b7b50db5927d2f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.705329:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788521952.705334:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521952.705340:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087c5a5d4/0x1b7b50db5927d2f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.705352:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087c5a5d4/0x1b7b50db5927d2f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788521952.772674:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1788521952.775063:0:15114:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:2.0:1788521952.775072:0:15114:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:2.0:1788521952.775086:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087c5a5d4/0x1b7b50db5927d2f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.775099:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087c5a5d4/0x1b7b50db5927d2f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.775108:0:15114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087c5a5d4/0x1b7b50db5927d2f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.775114:0:15114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80031400 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:2.0:1788521952.775119:0:15114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087c5a5d4/0x1b7b50db5927d2f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.775127:0:15114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087c5a5d4/0x1b7b50db5927d2f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.775211:0:15114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087c5a5d4/0x1b7b50db5927d2f9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521952.775219:0:15114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087c5a5d4/0x1b7b50db5927d2f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521952.775325:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98073100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+5:2363:x1875400799153664:12345-192.168.206.48@tcp:4:dd.0 Request processed in 70054us (269616us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788521952.775336:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:2.0:1788521952.783076:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521952.783114:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521952.783168:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788521952.783193:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521952.783252:0:15113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799153792 00000100:00100000:3.0:1788521952.783255:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799154048 00000100:00100000:3.0:1788521952.783265:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799154048 00000100:00100000:0.0:1788521952.783267:0:15113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799153792 00000100:00100000:0.0:1788521952.783319:0:15113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799153920 00000100:00100000:0.0:1788521952.783322:0:15113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799153920 00000100:00100000:1.0:1788521952.783334:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799154176 00000100:00100000:1.0:1788521952.783338:0:15112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799154176 00000100:00100000:3.0:1788521952.783389:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:3.0:1788521952.783399:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+8:2364:x1875400799153792:12345-192.168.206.48@tcp:4:dd.0 00002000:00010000:3.0:1788521952.784592:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6a9aade0, atime: 0x6a9aaddf, ctime: 0x0, blocks: 0x1807 00010000:00010000:3.0:1788521952.784601:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000650e4629/0x1b7b50db5927d300 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.784618:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1788521952.784622:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521952.784628:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650e4629/0x1b7b50db5927d300 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521952.784642:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000650e4629/0x1b7b50db5927d300 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521952.787336:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788521952.787684:0:15113:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788521952.787695:0:15113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788521952.788337:0:15113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400799154304 00000100:00100000:1.0:1788521952.788348:0:15113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400799154304 00000100:00100000:0.0:1788521952.792242:0:16656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:0.0:1788521952.792261:0:16656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+10:2364:x1875400799154048:12345-192.168.206.48@tcp:4:dd.0 00010000:00010000:0.0:1788521952.792302:0:16656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1371795/0x1b7b50db5927d307 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.792320:0:16656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521952.792324:0:16656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521952.792330:0:16656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1371795/0x1b7b50db5927d307 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521952.792345:0:16656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1371795/0x1b7b50db5927d307 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788521952.905535:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:1.0:1788521952.905945:0:15114:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:1.0:1788521952.905952:0:15114:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1788521952.905970:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000650e4629/0x1b7b50db5927d300 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.906189:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000650e4629/0x1b7b50db5927d300 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.906202:0:15114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000650e4629/0x1b7b50db5927d300 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.906210:0:15114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f829d4e00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:1.0:1788521952.906215:0:15114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000650e4629/0x1b7b50db5927d300 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.906226:0:15114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000650e4629/0x1b7b50db5927d300 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.906252:0:15114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000650e4629/0x1b7b50db5927d300 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.906286:0:15114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000650e4629/0x1b7b50db5927d300 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521952.906402:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+12:2364:x1875400799153792:12345-192.168.206.48@tcp:4:dd.0 Request processed in 122998us (123330us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788521952.906414:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:1.0:1788521952.906601:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:1.0:1788521952.906616:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f812e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+11:2364:x1875400799153920:12345-192.168.206.48@tcp:4:dd.0 00010000:00010000:1.0:1788521952.906738:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e86ae903/0x1b7b50db5927d30e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.906768:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521952.906774:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521952.906783:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e86ae903/0x1b7b50db5927d30e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.906796:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e86ae903/0x1b7b50db5927d30e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788521952.986420:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:1.0:1788521952.986917:0:16656:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:1.0:1788521952.986939:0:16656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1371795/0x1b7b50db5927d307 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.986955:0:16656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1371795/0x1b7b50db5927d307 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.986996:0:16656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1371795/0x1b7b50db5927d307 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.987006:0:16656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fb4000000 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:1.0:1788521952.987012:0:16656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1371795/0x1b7b50db5927d307 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.987022:0:16656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1371795/0x1b7b50db5927d307 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.987047:0:16656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1371795/0x1b7b50db5927d307 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.987056:0:16656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1371795/0x1b7b50db5927d307 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521952.987218:0:16656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+11:2364:x1875400799154048:12345-192.168.206.48@tcp:4:dd.0 Request processed in 194957us (204096us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1788521952.987230:0:16656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:1.0:1788521952.987271:0:16656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:1.0:1788521952.987286:0:16656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fad6fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+10:2364:x1875400799154176:12345-192.168.206.48@tcp:4:dd.0 00010000:00010000:1.0:1788521952.987326:0:16656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df46bef0/0x1b7b50db5927d315 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.987340:0:16656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521952.987352:0:16656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521952.987361:0:16656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df46bef0/0x1b7b50db5927d315 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521952.987376:0:16656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df46bef0/0x1b7b50db5927d315 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788521953.077328:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:2.0:1788521953.077936:0:15114:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:2.0:1788521953.077943:0:15114:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:2.0:1788521953.077960:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e86ae903/0x1b7b50db5927d30e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521953.077975:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e86ae903/0x1b7b50db5927d30e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521953.077985:0:15114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e86ae903/0x1b7b50db5927d30e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521953.078011:0:15114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5000 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:2.0:1788521953.078018:0:15114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e86ae903/0x1b7b50db5927d30e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521953.078028:0:15114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e86ae903/0x1b7b50db5927d30e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521953.078055:0:15114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e86ae903/0x1b7b50db5927d30e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521953.078064:0:15114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e86ae903/0x1b7b50db5927d30e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521953.078241:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f812e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+10:2364:x1875400799153920:12345-192.168.206.48@tcp:4:dd.0 Request processed in 171623us (295093us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788521953.078252:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:2.0:1788521953.078293:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:2.0:1788521953.078316:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+9:2364:x1875400799154304:12345-192.168.206.48@tcp:4:dd.0 00010000:00010000:2.0:1788521953.078353:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004383965f/0x1b7b50db5927d31c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521953.078367:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788521953.078372:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521953.078378:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004383965f/0x1b7b50db5927d31c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521953.078402:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004383965f/0x1b7b50db5927d31c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788521953.078777:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1788521953.141850:0:16656:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:2.0:1788521953.141862:0:16656:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788521952 -> 1788521953 00002000:00010000:2.0:1788521953.141865:0:16656:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1788521953 00002000:00010000:2.0:1788521953.141867:0:16656:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:2.0:1788521953.141886:0:16656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df46bef0/0x1b7b50db5927d315 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521953.141901:0:16656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df46bef0/0x1b7b50db5927d315 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521953.141912:0:16656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df46bef0/0x1b7b50db5927d315 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521953.141920:0:16656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996fbc6d5800 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:2.0:1788521953.141926:0:16656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df46bef0/0x1b7b50db5927d315 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521953.141937:0:16656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df46bef0/0x1b7b50db5927d315 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521953.141973:0:16656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df46bef0/0x1b7b50db5927d315 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521953.142001:0:16656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df46bef0/0x1b7b50db5927d315 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521953.142132:0:16656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fad6fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+11:2364:x1875400799154176:12345-192.168.206.48@tcp:4:dd.0 Request processed in 154845us (358931us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788521953.142187:0:16656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 6 00000001:00080000:1.0:1788521953.142465:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00000001:00080000:3.0:1788521953.199852:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:1.0:1788521953.200406:0:15114:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1788521953.200427:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004383965f/0x1b7b50db5927d31c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521953.200443:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004383965f/0x1b7b50db5927d31c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521953.200453:0:15114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004383965f/0x1b7b50db5927d31c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521953.200461:0:15114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996f80031a00 already unused, calling callback (ffffffffc16c14f0) 00010000:00010000:1.0:1788521953.200466:0:15114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004383965f/0x1b7b50db5927d31c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521953.200477:0:15114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004383965f/0x1b7b50db5927d31c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521953.200500:0:15114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004383965f/0x1b7b50db5927d31c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521953.200529:0:15114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004383965f/0x1b7b50db5927d31c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521953.200652:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:061e1e3c-4c81-4afa-bc16-e9ffdc93bc8f+5:2364:x1875400799154304:12345-192.168.206.48@tcp:4:dd.0 Request processed in 122343us (413318us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788521953.200664:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00010000:00010000:1.0:1788521953.678450:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521954.710270:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788521954.908804:0:16694:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:3.0:1788521955.662419:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1e22794d-c642-4031-a520-725ebfafbfe5:3307:1875400816958464:0@lo:400:kworker.0 00000100:00100000:3.0:1788521955.662529:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521955.662609:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875400816958976:0@lo:400:kworker.0 00000100:00100000:3.0:1788521955.662638:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521955.662668:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788521955.662674:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875400816958848:0@lo:400:kworker.0 00000100:00100000:3.0:1788521955.662716:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521955.662761:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98072a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816958720:0@lo:400:kworker.0 00000100:00100000:3.0:1788521955.663236:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521955.663263:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788521955.663271:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816958592:0@lo:400:kworker.0 00000100:00100000:3.0:1788521955.663309:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521955.663331:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996f98071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875400816959104:0@lo:400:kworker.0 00000100:00100000:3.0:1788521955.663355:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521955.663389:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816958464 00000100:00100000:3.0:1788521955.663398:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816958464 00000100:00100000:3.0:1788521955.663457:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788521955.663468:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb5fb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+19:3307:x1875400816958464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521955.663527:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb5fb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e22794d-c642-4031-a520-725ebfafbfe5+19:3307:x1875400816958464:12345-0@lo:400:kworker.0 Request processed in 61us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521955.663535:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788521955.663695:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816958976 00000100:00100000:3.0:1788521955.663700:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816958976 00000100:00100000:3.0:1788521955.663760:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816958848 00000100:00100000:3.0:1788521955.663763:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816958848 00000100:00100000:3.0:1788521955.663932:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816959104 00000100:00100000:3.0:1788521955.663936:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816959104 00000100:00100000:3.0:1788521955.663953:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788521955.663959:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875400816958976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521955.664001:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875400816958976:12345-0@lo:400:kworker.0 Request processed in 42us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521955.664007:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788521955.664021:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788521955.664046:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875400816958848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521955.664077:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875400816958848:12345-0@lo:400:kworker.0 Request processed in 33us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521955.664083:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788521955.664095:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788521955.664102:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875400816959104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521955.664133:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875400816959104:12345-0@lo:400:kworker.0 Request processed in 32us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521955.664175:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788521955.664206:0:16497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816958720 00000100:00100000:3.0:1788521955.664210:0:16497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816958720 00000100:00100000:3.0:1788521955.664239:0:16497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816958592 00000100:00100000:3.0:1788521955.664242:0:16497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816958592 00000100:00100000:3.0:1788521955.664266:0:16497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788521955.664272:0:16497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816958720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521955.664316:0:16497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816958720:12345-0@lo:400:kworker.0 Request processed in 44us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521955.664323:0:16497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788521955.664334:0:16497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788521955.664340:0:16497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996f98070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816958592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521955.664366:0:16497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996f98070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816958592:12345-0@lo:400:kworker.0 Request processed in 27us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521955.664372:0:16497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788521955.664393:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788521955.664397:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788521955.664400:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521955.664446:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816958592:0@lo:400:kworker.0 00000100:00100000:3.0:1788521955.664470:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875400816959104:0@lo:400:kworker.0 00000100:00100000:3.0:1788521955.664480:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1788521955.664487:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff996f98073b80, transno 8589934595 00000004:00080000:3.0:1788521955.664498:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1788521955.664522:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98072a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816958720:0@lo:400:kworker.0 00000100:00100000:1.0:1788521955.665245:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb4a65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816959232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521955.665311:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521955.665360:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816959232 00000100:00100000:1.0:1788521955.665366:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816959232 00000100:00100000:1.0:1788521955.665405:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788521955.665414:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fb4a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816959232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521955.665452:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788521955.665494:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fb4a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875400816959232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521955.665501:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788521955.665565:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb4a65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875400816959232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521955.667519:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff996fb4a65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816959360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521955.667613:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521955.668645:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400816959360 00000100:00100000:1.0:1788521955.668659:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400816959360 00000100:00100000:1.0:1788521955.668719:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788521955.668730:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996fbc3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816959360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788521955.668958:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521955.669060:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996fbc3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875400816959360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 330us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521955.669068:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788521955.669131:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996fb4a65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875400816959360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521955.675491:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875400816958848:0@lo:400:kworker.0 00000100:00100000:3.0:1788521955.675520:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1e22794d-c642-4031-a520-725ebfafbfe5:3307:1875400816958464:0@lo:400:kworker.0 00000100:00100000:3.0:1788521955.675533:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff996f98070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875400816958976:0@lo:400:kworker.0 00010000:00010000:0.0:1788521955.726433:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788521956.430458:0:14457:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788521956.430468:0:14457:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788521956.430514:0:14457:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788521956.430521:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 Debug log: 29111 lines, 29111 kept, 0 dropped, 0 bad.